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ABSTRACT 


BART  I 


Ths  several  atatiatlcal  approach* a tn  the  problem  of 
signal  detectability  which  han  appeared  in  the  lltaraturo  art 
shown  to  be  essentially  equivalent.  A general  theory  based  on  like* 
lihood  ratio  osfcrace*  the  criterion  approach,  for  either  restricted 
false  alarm  probability  or  rlnleua  velgited  error  type  optimum,  and 
the  a posteriori  probability  approach.  Receiver  reliability  Is 
shown  to  be  a function  of  the  distribution  functions  of  likelihood 
ratio.  The  existence  and  uniqueness  of  solutions  for  ths  various 
approaches  is  proved  under  general  hypothesis. 


PART  XI 


Ths  full  power  of  ths  theory  of  si(pal  detectability  can 
be  applied  to  detection  In  Qaussiaa  noise,  and  several  general  re- 
sults are  given.  Six  special  cases  are  considered,  and  the 
expressions  far  likelihood  ratio  are  derived.  The  resulting  opti- 
mal receivers  are  evaluated  by  ths  distribution  functions  of  ths 
likelihood  ratio.  In  two  of  the  special  oases  studied,  the  uncer- 
tainty of  the  siffial  enseribl*  can  be  varied,  throwing  soon  11  git  on 
ths  effect  of  uncertainty  on  probability  of  detection. 
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H* t XI.  APPLICATIONS  WITH 
QMJ3QWI  NOJBI 


MSm>  fflEPAHATELYl 


Part  X.  THE  GENERAL  THEORY 


1*1  Introduction 


Tho  chief  conoluolon  obtained  from  the  general  theory  of  signal  detec- 
tability proscnted  In  Fart  Z le  that  a receiver  vhich  calculate e the  likelihood 
ratio  for  each  receiver  Input  la  the  options  receiver.  The  receiver  eon  be 
evaluated  (e.g.,  false  alarm  probability  and  probability  of  detection  can  be 
found)  If  tlie  dletrlbution  functions  for  likelihood  ratio  are  known*  it  le  the 
purpoee  of  Fart  n to  ccnelder  a maker  of  different  eneeribles  of  s Lgpile  vlth 
Pause lan  noiee.  For  each  case#  a poeelblo  receiver  design  ie  dleoueeed*  She 
primary  emphooio#  however#  le  on  obtaining  the  distribution  functions  for  like- 
lihood ratio#  and  hence  on  eetinatee  of  rocoivor  performance  for  the  various 


The  special  eases  which  aro  presented  were  chosen  froo  the  elatfLest 
probleme  In  elgnal  detection  which  cloooly  roprooont  practical  eltuatlone.  They 
are  listed  In  Sable  X along  with  cxamploo  of  engineering  pnctoleos  in  «hlcfc  t hey 
ft ad  application* 
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1AB1X  I 


Description  of 
Signal  EnsemM  a 

Application 

Signal  Ehown  Exactly3’ 

Coherent  radar  with  a target  of 
knov.ii  range  end  character 

Signal  Known  Except  for 
Phase2* 

i 

Ordinary  pulse  radar  with  no  inte- 
gration and  with  a target  of  known 
range  and  character. 

Signal  a Sample  of  White 
Gaussian  Noise 

Detection  of  noisr-like  signals; 
detection  of  speech  sounds  in 
Gaussian  noise. 

Video  Design  of  a Broad 
Band  Receiver 

Detecting  a pulse  of  known  start- 
ing tine  (such  as  a pulse  frost  a 
radar  beacon)  vith  a crystal-video 
or  other  typo  broad  band  receiver. 

A Radar  Case  (A  train  of 
pulses  vith  incoherent 
phase)2 

Ordinary  pulse  radar  vith  inte- 
gration and  vith  a target  of  knersn 
range  and  character. 

Signal  One  of  M Orthogo- 
nal Sl&ials 

Coherent  radar  where  the  target  is 
at  one  of  a finite  nunber  of  non- 
overlapping  positions. 

Signal  Che  of  M Orthogo- 
nal Signals  Known  Except 
for  Phase 

Ordinary  pulse  radar  vith  no  inte- 
gration and  vith  a target  which  j 
nay  appear  at  one  of  a finite 
amber  of  nan-overlapping  posi- 
tions. 

^Our  treatment  of  these  two  fundamental  cases  is  based  upon  Woodward  and  Davies* 
work,  but  here  they  are  troated  in  terns  of  likelihood  ratio,  and  hence  apply 
to  er  Uatim  type  receivers  as  veil  as  to  a posteriori  probability  type 
receivers. 


la  essentially  the  case  treated  by  Middleton  in  Ref.  7. 
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Xn  the  lent  tvo  caooo  the  uncertainty  in  the  nigral  can  he  vnrlod,  and  sons 

llcht  la  throvn  on  the  rolatlonnhip  botvoon  unoortainty  and  the  ability  to 

dotoct  oicpiuls.1  The  vartofcy  of  axonplos  prooontod  should  serve  to  suggest 

Bothodo  for  attacking  othor  simple  signal  detection  problem  and  to  give  lnel^st 

Into  problems  too  complicated  to  allow  a dlreot  solution* 

It  should  he  homo  In  that  this  report  dloeuesos  the  do  toot  ten  of 

signal*  in  noise ; the  problon  of  obtaining  infonniicn  from  signals  or  about 

signals,  oxcopt  as  to  whether  or  not  they  are  presont,  Is  not  discussed,  fur- 

2 

tho  more,  In  treating  tho  sposlal  cases,  the  noise  vae  assumad  to  ho  Oausslan. 

The  roader  will  probably  find  tho  discus  a Ion  cf  likelihood  ratio  and 
its  Attribution  oaslor  to  follow  if  ho  keopa  In  Bind  tho  connection  between  a 
criterion  type  rocoivur  and  likelihood  ratio,  to  an  optimum  criterion  type 
flyotea,  tho  oporator  vlU  say  that  a signal  la  present  whenever  the  likelihood 
ratio  la  ebovo  a certain  level  p.  Be  will  eay  that  only  no  Iso  la  present  when 
tho  likelihood  ratio  la  bolow  p.  for  oaeh  operating  level  0,  there  lo  a false 
atom  probability  and  a probability  of  detection.  The  false  atom  probability 
la  the  probability  that  the  likelihood  ratio  JL  (x)  will  be  greater  tten  p if 
no  olcpal  Is  sent;  this  Is  by  definition  the  ccapleoentery  distribution  function 
7g(P).  Likewise,  the  complementary  distribution  Tgg(P)  is  the  probability  that 
t (x)  will  be  ereator  than  0 If  there  Is  elpua  plus  noise,  and  hence  7gf(p)  Is 
the  probability  of  doteotlon  if  a signal  is  sent, 

*The  only  discussion  in  tho  literature  on  the  effect  of  uncertainty  on  slpul  de- 
tectability which  has  saw  to  our  attention  is  in  Davies,  Ref . 8,  where  the  effect 
upon  signal  detectability  of  not  knowing  carrier  phase  Is  shown  quantitatively. 

2flea  tho  footnote  on  page  K with  reference  to  ths  spectra  of  tbs  as  tuned 
noise. 
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>.2  Gaussian  Nolot 


Thr  ouch  out  Part  XX,  receiver  Input  voltages,  which  art  functions  of 
tlmo,  aro  assumed  to  bo  do  fined  for  all  tlmo*  t in  an  observation  interval, 

Oi  t$  T.  Thoy  oro  oloo  assumed  to  bo  limited  to  a band  of  frequencies  of 
width  W.  By  the  Caroline  theorem,1  each  recolvor  input  can  be  thougit  of  a« 
a point  in  a 2WT  diaoneional  epace,  tho  coordinates  of  the  point  being  the  value 
of  tho  function  at  tho  "cample  points"  t ■ ^ , for  1 & i 5 SWT.  The  notation 
x(t),  or  Dimply  x, denote o a recolvor  input,  and  denotes  th*  1th  oamplo  value, 
or  coordinate.  The  signal  a a it  would  appear  at  the  receiver  Input  in  the 
absence  of  no  ice  Is  denoted  by  s(t),  or  simply  e,  and  the  coordinates,  car  sample 
valueo,  of  o ore  denotod  by  s^.  The  recolvor  input,  which  may  be  due  to  nolee 
alone  or  to  signal  plus  noieo,  is  random  because  of  the  presence  of  noise. 

Thoref oro , only  the  probability  distribution  for  the  receiver  inputs  x(t)  can 
bo  opeclfled.  The  distribution  must  be  given  for  the  receiver  inputs  both 
when  thero  is  no  loo  alone  and  when  thoro  lo  signal  plus  noise.  The  probability 
distributions  aro  described  In  this  royort  by  giving  the  probability  density 
function  f0N(x)  and  fN(x)  for  the  receiver  Inputs  x In  the  2VT  dimensional  space. 

The  nolee  considered  in  Port  11  Is  always  Gaussian  noieo  to 

2 

the  bandwidth  W,  and  having  a uniform  spectrum  over  the  band.  This  lo  ordi- 
narily called  white  Gaussian  nolee.  The  probability  density  function  for  white 
Gaussian  noieo,  and  banco  for  the  rocolvsr  Inputs  when  there  is  noieo  alone,  is: 


fnW 


, or 


o-i) 


Appondlx  D. 


zIf  tho  noise  spoctrum  lo  band  limited,  but  not  uniform,  tho  noise  and  olgrwle 
can  be  put  through  a filter  which  makes  tho  notoo  uniform,  and  than  tho  theory 
can  be  applied.  Seo  n.  W.  Bodo  and  C.  E.  Shannon,  "A  SimpUfied  Derivation  of 
Llnoar  Least  Squoro  Smoothing  and  Prediction  Theory,"  Proe.  I.R.S.,  Voi.  38. 
p.  417,  April  1950. 
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a 

'$XP  [“  2N  % **  ] 


(3.2a) 


vhoro  a is  the  diaencion  of  the  8po.ce,  1.©,,  2WT,®  an’  H la  the  noise  pcwar.^ 
It  con  Ira  ahxm  that  this  ensemble  of  raise  functions  has  a Gaussian  distribu- 
tion at  every  tins  and  that  its  epoctrua  is  unifora. 


Kir  the  carp  ling  theorem. 


I *i2 


/ M: 


(3.3) 


Therefore 


— 1 

Vx)  -(#  “» [-i.  / 


x(t)2  dtj  , 


(3.2b) 


if  ^ 

vhoro  TT0  « g la  the  nolee  power  per  unit  bandwidth.*^ 

If  the  ai©ials  and  their  probabilities  are  Imam,  then  the  signal  plus 

noise  probability  density  function,  fgg(x),  can  be  fetmd  by  the  convolution 

Integral;  as  described  In  Section  2«^ 


^Unless  otherwise  Indicated,  the  Unite  on  the  son  are  1 » 1 to  i -»  n » as. 
r ,21  n 


2x3  SX^ 


[fi. 


called  th en  fg(x)  » II  f^J^),  i.e.,  tho  x4  are 


Independent  and  each  boo  fj{(x^)  for  its  probability  density  function.  Vat  a 
discussion  of  "independent.,''  see  Croiawr,  Kef.  Ik,  p.  159. 

^This  assumes  the  circuit  izpedance  la  normalized  to  one  eta. 

*So©  Appendix  K. 

^Thls  form  of  the  expression  f ; f^(x),  and  the  cocrrespoodLiog  feme  of  the 
equations  for  f.-g(x)  and  jt  (x)  were  first  Se,-ivec  tytim&axi.  See  Bwdagvt 
and  Ilteriee,  Sofia.  2 ami  3» 

^Seo  page  13  of  Part  I, 
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a 

saW  * f A f'sl  (V“i)2 1 «%(•) 

a v 2 1 i»i  J 

a 

= (db)  GXp  [“  5n  ^ si  J ["  4:  ^ 8i2]GXp[|  Vi  dPS<fl> 

a 

%nW  - Am  ®s(“)  -(ssf  A f-  r /[*( t)-»(t)12  at]®3c) 

B B «*  °o  J 

a (3.^) 

- (^)  «*  [-  *2  dt]  y^p  [-  ^ / *»]  «*  [^/» dt]  «%« 


The  factor 


«pj**  ^ f x2(t)  dtj  » exp  |^-  ~ £ *]  can  be  lay-  .;ht  out  of 


the  Integral  atnce  it  does  aot  depend  on  b,  the  variable  of  integration.  Note 


that  the  Integral 


f & Z't  m *W 


(5.5) 


la  the  energy  of  the  expected  elgaal,  utitle 


r*  , 

J X(t)  «(t)  dt  » ~ J 


(3.6) 


lo  the  croee  correlation  between  the  ejqpected  aifeel  and  the  receiver  Input. 


footnote  3 on  pane  3* 


,,<**•'«•**  'V&W  **1+®  * ' 
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3.3  Livelihood  Itatio  vith  Gaussian  Noise 

livelihood  ratio  is  defined  no  the  ratio  of  the  probability  density 
functions  fgj*(x)  and  f^(x).  With  vhite  Gaussian  noise  it  is  obtained  by  dividing 
E4  (3.V)  by  E*  (3.2). 

£(x)  - [-  exp||  Z^  xisij  or  (3*7») 

j£(x)  - ^'Jexp|^‘  / *(*)  *(*)  dtJ  ®g(*)  • (3*Tb) 


If  the  slgaal  is  known  exactly  or  completely  specified,  the  probability 
for  that  signal,  or  point  s,  Is  unity,  and  the  probability  for  ary  set  of  points 
not  containing  s is  xero.  then  the  likelihood  ratio  becenee 


A(*)  - «P  £ - «*p  | | Z x^  , or  (3.6a) 

- exp  [-^i]e*p[^  J . (3.8b) 

2hue  the  general  formulas  (3.7a)  and  (3.7b)  for  likelihood  ratio  state  that  /(x) 
is  the  uoi^ited  average  of  «6a(x)  over  the  set  of  ell  signals,  i.e.. 


/«  - A (*)  a P (•) 

B * 8 


(3-9) 


If  the  distribution  function  P (e)  depends  on  various  parameters  such. 

s 

as  carrier  phase,  glyal  energy,  or  carrier  frequency,  and  if  the  diotrifcutioaa 
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in  these  paranetors  are  Independent^  the  expression  tat  likelihood  ratio  can  ho 
aiaplified  ecuevi’at.  If  these  parameters  are  indicated  b 7 '•**  s*a#  *®d 

the  associated  probability  density  functions  are  denoted  by  **** 

d Pg(s)  - fi(rA)  ”•  %(ra)  drx  4^ 

The  likelihood  ratio  hecoeee 

- / •••  / -28(*)  ^.(*1)  ••*  **1 

* / [^(yn)  ***  -4W  ***]  ”*]*»  * 

Thus  the  likelihood  ratio  can  he  found  by  averaging  slth  respect  to  the 

paranetere* 


^Crtuaer,  Ref.  lh,  p.  159. 
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k.  LIKELIHOOD  BAIIO  AND  ITS  DISTRIBOTION  FQH  SPECIAL  CASES 


V.l  Introduction 

The  purpose  of  this  section  is  to  derive  expressions  or  approximate 
expressions  for  likelihood  ratio  and  its  distribution  functions  for  a number 
of  special  signals  In  the  presence  of  Gaussian  noise.  The  results  obtained  in 
this  section  are  saasarlzad  and  discussed  in  Section  5* 

h.2  The  Cass  of  a Signal  Shewn  Exactly 

The  likelihood  ratio  for  the  case  when  the  signal  is  known  exactly 
has  already  been  presented  in  Section  3«3,  E4  (3.8). 


k 11,1 


] • 


[-^j  «*>  [| 

£(x)  « exp  *~j  exp  | j x(t)  s(t)  dtj 


(4.1*) 

(4.1b) 


As  the  first  step  in  finding  the  distribution  functions  far  £(x),  it 

1 *. 

is  convenient  to  find  the  distribution  for  ~ J xl8i  '&ea  there  Is  noise  alone. 
Then  the  input  x » (x^,  Xg,  ...,  x^)  is  due  to  white  Gaussian  noise.  It  can  be 
seen  free  Eq  (3.1)  that  each  x^  has  a normal  distribution  with  zero  neon  and 
variance  9 • VK0  and  that  the  x^  are  independent.  Because  the  s^  are  constants 
depending  on  the  algpal  to  be  detected,  s - (s^,  Sg,  ea),  each  suanand 

1 |L  _ V * . .u.v ®f 

i 


a monel  distribution  vitix  mean 


T tine,  the  naan  «f  V and  vart- 


2 


«i  84  e±* 

mace  time  the  variance  of  x4  — zero  and  9 • respectively. 

r r 1 

Because  the  Si  are  independent,  the  ausaaaads  |»  SjX^  are  independent,  each  with 
normal  distributions,  and  therefore  their  sum  has  a normal  distribution  vith 
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the  sun  of  the  naans  — i.e.,  zero  — sod  -variance  the  aua  of  the 


variance. 


I X - ggM.  , ® « 2X 

y X Bq  Kolse  Power  Per  Unit  Bandwidth 


SiSMfl.  Tscrtfr- 


M3 


She  dlotrlbutlaa  for  j X Xl6x  noise  alone  la  thus  norml  with  xevo  aeon 


and  variance  ~ . Sscslllsg  (bUn) 


a, 


j£(x)  * exp 


^ ^ I ^ aWi] 


(b.lc 


ft  Is  aeon  that  the  distribution  for  j X Vl  6821  ttBe^  ajrBCtl3r  Intro- 
ducing a defined  by 

p * «n$  J-|>  + aj  , ora  » ~+  ia>  (b-33 


She  Inequality  «/{x}2  £ Is  equivalent  to  a,  and  therefore 


CO 

f,(«  *yS  f ■*  ['aS1*] 


e.*i 


She  distribution  for  the  case  of  *l£?»l  pine  nodes  can  be  found  by 
using  Theorem  8,  which  states  Hat8 


®s*W  - * »*« 


M 


Cnacr * Bef.  IV,  p.  232. 
STSoe  fart  1,  jsu  2b  sad  27* 
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Differentiating  £3  (4.4), 


fK 


aye)  * V1^ 

and  ccribining  (4.3)»  (4.5)*  and  £.6), 

6 


(£)-  • 


(4.6) 


Shun 


®»<M-  V«5 

jo 


(4.7) 


-V*  / «**  [-®(y  -jrf  ]<*  (4*8) 


In  eunnaiy,  a,  and  therefore  In  p,  has  a normal  distribution  vith  sigoal 

plus  noise  as  veil  as  with  noise  alone;  the  variance  of  both  distributions 

in  ~ , and  the  difference  of  the  naans  is  =-  . 

»o 


She  receiver  operating  characteristic  curves  in  71g.  4.1  are  plotted 

for  any  case  In  vhich  /n  / has  a notnaal  distribution  vith  the  earn  variance 

both  vith  noise  alone  and  vith  signal  plus  noise.  She  paranetar  d In  this 

figure  Is  equal  to  the  square  of  the  difference  of  the  aeons,  divided  by  the 

variance.  Sheee  receiver  operating  characteristic  curves  apply  to  tho  case  of 

the  signal  known  exactly,  vith  d ■ ~ • 

"o 

Eq  (4.1b)  describes  vhat  the  ideal  receiver  should  do  far  this  case. 


She  essential  operation  in  the  receiver  is  obtaining  the  correlation 


,/s(t)x(t 


4fhe  change  in  elpi  appears  because  the  distribution  functions  %yO)  sad  F%(p) 

are  probabilities  that  ./(x)  will  lie  between  0 and  CD,  not  - CD  and  p tut  is 
usually  the  caso.  If  the  density  function  for  Fgjjfp)  is  called  g(0),  then 

fO 


* -CO),  and  W0) 


dfl 


/ 


cO)  ajJ. 


-'awfe**'.  -3-1 
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Tbo  othor  operations,  nultiplyi^  "by  a constant,  adding  a constant,  and  taking 
the  exponential  function,  can  be  taken  care  of  siepiy  in  the  calibration  of  the 
roccivor  output.  Electronic  naans  of  obtaining  cross  correlation  have  been 
developod  recently.1 

It  tbo  tom  at  the  is  simple,  there  ia  a ainple  voy  to  obtain 

this  exons  correlation.2  Suppose  h(t)  is  the  ispulst  response  at  a filter. 

5!ho  response  e (t)  of  the  filter  to  a voltage  x{t)  it? 


e0{t)  - / x(r)h(t-r)a r 

.<x> 

If  a filter  can  he  synthesised  so  that 

h(t)  • sfr-t)  o4t&7 

h(t)  * 0 othsrvlse, 


(*.9) 


rT 

«0(*)  * J x(T)a(r)dT  , (k.U) 

0 

so  that  the  response  of  this  filter  at  tine  T la  the  arose  correlation  required. 
Thus,  the  ideal  receiver  consists  aiaply  of  a filter  and  aaplifiers. 

It  should  ho  noted  that  this  filter  is  tiw  few,  except  far  a constant 


footer,  as  that  specified  when  one  asks  tor  the  filter  which  saxtaisee  peak 
signal  to  average  noise  power  ratio.^ 

1Harringtcn  end  Bogere,  Bef.  16;  Hurting  and  jfeade,  R«f.  17 J lee,  Ghoat&aa,  and 
Via  oner,  Bef.  IS;  levin  and  Bolntsos*  Bof . 19. 

2Thim  appears  to  he  due  to  Woodward.  Bee  Woodward,  Bef.  9,  and  Woodward  sal 
Davies,  Bef.  J. 

3s.  Cddawi,  ftaasf carnation  Calculus  tmd  Electrical  Trfiftiieate.  arentice  Ball, 

*»*  Boric,  29*9*  1*8- 


Xavson  and  Uhlcnbcck,  Bef.  1,  p.  206;  Iforth,  Bef,  11. 
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RECEIVER  OPERATING  CHARACTERISTIC. 
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4,3  Simal  Known  Except  for  Carrlor  Hams 

The  signal  ensemble  considered  in  this  section  consists  of  all 
signals  which  differ  from  a given  amplitude  and  frequency  modulated  signal  only 
in  their  carrier  phase,  end  all  c carrier  phases  ore  assumed  equally  likely. 

o(t)  a f(t)  cob  ( Wt+0(t)-o)  * (4.22) 


Since  the  unknown  phase  angle  6 has  a uniform  distribution, 


aps(e) 


(4.23) 


The  likelihood  ratio  can  he  found  hy  applying  2q  (3.7),  and  since  the  signal 
energy  Efs)  1*  the  some  for  all  values  of  carrier  phase  0,1 


j£(x)  » atp 


Expanding  s into  the  coefficients  of  cos  0 and  sin  0 will  ha  helpful? 

s(t)  - f(t)  coa£tot4fJ(t))cos  e + f(t)  ein£wt-^(t))sin  0 , (4.23) 


jj  2xiBi  " oos  d | Ixi  f(V  cos  ("tj  ♦ J#(t±)) 

+ sin  « | S x1  x (t^  siaCoiti  ♦ 0ft*  J (4.l£) 

Because  we  wish  to  integrate  with  respect  to  0 to  find  the  i 4Tw>yi 
ratio,  it  is  easiest  to  introduce  parameters  similar  to  polar  coordinates 
(r,  0o)  such  that 

^or  this  to  he  rigorously  true,  it  is  sufficient  that  the  signal  he  tias  limited 
and  hare  its  line  spectrum  zero  at  zero  frequency  and  at  all  frequencies  equal 

to  or  greater  thun  §■—  » 

2 ti  denotes  the  sample  point,  i.c,,  t^  **  4,  « 


? 

i 
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and  therefore 


| r coo  ©o  « | cos  (uti*  ^*1*) 


| r oin  0o  « | loH  f(t,)  ala  (w  tA  + ^(t^) 


| 1 *iH  « £ coe  (9  - 80) 


C^-17) 


(4.18) 


Using  this  form  the  likelihood  ratio  bocotnes 


2a 

j0(x)  * exp  Jlj  J exp  J | coa  (9  - 90)J  |~ 

" °*p  jj^  | *o  { 5 ) 

vhere  I0  is  the  Bessol  function  of  zero  order  and  pure  imaginary  argument. 

IQ  io  a strictly  monotone  increasing  function,  and  therefore  the 
likelihood  ratio  will  he  greater  than  a value  8 if  and  only  if  - la  greater  then 

s 

eooe  value  corresponding  to  0.  The  Quantity  r la  defined  by  the  Eq  (4.17);  jj 
is  the  square  root  of  the  aims  of  the  squares  of  the  right-hand  sides.  The 
probability  that  £ will  exceed  any  certain  value  can  be  computed  by  observing 
that  each  of  the  right-hand  sides  is  times  the  cross  correlation  of  x(t) 

! with  a fixed  signal,  either  f(t)  cos  £ cut  ♦ jf(t)J  or  f(t)  sin  |ut  + j#(t)J  . 
Therefore,  the  distribution  of  each  can  be  found  in  tbs  same  aruinn r as  the  dis- 
tribution of  j D x^s^  was  found  for  the  case  of  the  signal  known  exactly,1  and 
both  g cos  90  and  g sin  ©0  have  normal  distributions  with  zero  mean  and  variance 

~ . Furthermore,  f(t)  cos  (wt  + 0(t))  and  f(t)  sin  ( ut  + f!(t)  ) are  out 
o 

of  phase,  or  orthogonal,  and  therefore  r cos  90  and  r sin  ©o  have  independent 
o 

distributions. 


^ee  footnote  1,  p.  17* 
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A 


y 

Becauao  - » ^/(~  coa  Qq)  2 + ( § sin  &q  } 2 , the  probability  that 

— will  exceed  any  fixed  value  la  given  'by  the  vell-taovn  chi-square  diatribu- 
N 1 

tion  for  two  degrees  of  freedom,  K^fcx2).  The  proper  normalization  yielding 

y / Hq 

zero  man  ana  unit  variance  requiroo  that  the  variable  be  — 

PIi(l->/S 2°)  " *2^  * ^,2c 


If  a is  defined  'by  the  equation 


8 * exp 


HM/H 


(*.21) 


the  distribution  for  £{x)  in  the  presence  of  noise  alone  1b  In  the  simple  form 


Ij(3)  * ^ j|  • 


Using  Theoren  8 of  Section  2,  namely 

3 dF^P)  - dF^O) 

hut  making  use  of  the  parameter  a,  we  form  first 


«mt^i  hence 


* - a axp  F - ^ J to  t 

«sj{9)  - - «P  [-^]a“r  ['t]1.^/^0) 


Integrate  fren  a to  Infinity, 


?Sh(3}  * [**  / a t]  *o(4«)  **  * 


(4.22) 


(4.23) 


(4.24) 


(4.25) 


(4.26) 


^Cramer,  Ref.  14,  p.  253/  or  Hoel,  p.  G., 
Uiley,  1?47/  p.  134. 


r—  ENGINEERING  RESEARCH  INSTITUTE  • UNIVERSITY  OF  MICHIGAN  - 

Eqo  (4.22)  and  (4.26)  yield  the  receiver  operating  characteristic  In  parametric 
form,  and  Eg  (4.21)  gives  the  associated  operating  levels.*  These  ore  graphed 
in  Fig.  4.5  lor  the  sane  values  of  signal  energy  to  noise  per  unit  bandwidth 
ratio  as  vere  used  when  the  phase  angle  vac  known  exactly.  Fig.  4.1,  oo  that  the 
effect  of  knowing  the  phase  can  he  easily  seen. 

If  the  signal  is  sufficiently  single  so  that  a filter  could  ho  syn- 
thesized to  natch  the  expected  signal  far  a given  carrier  phase  © as  in  the  case 

of  a signal  known  exactly,  theft  there  la  a single  va y to  design  a receiver  to 

obtain  likelihood  ratio.  Far  simplicity  lot  ua  consider  only  amplitude  nodulated 
signals  [fS( t)  « 0)  in  Eg.  (4*13)}.  let  us  also  choose  6*0.  (Any  phase  could 
have  been  chosen.)  Then  the  filter  has  impulse  response 

h(t)  - f(T-t)  cos  [w(T»t)]  OS  til 

• 0 otherwise.  (4.27) 

The  output  of  the  filter  in  response  to  x(t)  is  then 


®o(t) 


J*  x(r)  h(t-r)  dr  - x(r  ) ffr-rtvt)  cos  at  (r-fT-t)  dr 

* 

cos  n>(T-t)  J x(r)  f(r-»T-t}  cos  bit  dr 
t-* 

t 

- sin  wfr-t)  J x(t  ) i(T-a-t)  sin  « r d r . (4.28) 


Graphs  of  values  of  the  integral  (4.2 6)  along  with  approximate  expressions  for 
omall  and  for  large  values  of  a appear  in  Rice,  Ref.  20.  Tables  of  this 
function  have  been  compiled  by  J.  I.  Marcum  in  an  unpublished  report  of  the 
Rand  Corporation,  "Table  of  Q-FUnctiona,"  Project  Rand  Report  RM-399. 
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In  solving  for  the  distribution  functions  for  Jtt  It  is  convenient 
to  introduce  the  porcuaoter  a,  defined  by  the  equation 


R **  (ms) 


Itf-fS  2 / 


(4.32) 


1 _ p 

Then  the  condition  jt(x ) 2 0 is  equivalent  to  the  condition  that  ^ 2.  Xj  2 ct  * 

In  the  presence  of  noise  alone  the  randaa  variables  (^=)  have  zero  aeon  and  unit 
variance,  and  they  are  independent.  Therefore,  the  probability  that  the  sum  of 
the  squares  of  these  variables  vill  exceed  is  the  chi-square  distribution 


vith  n degrees  of  freedom,  i.e.. 


*N(P)  - 


(4.33) 


Similarly,  in  the  presence  of  signal  plus  noise  the  random  variables 


(AJ| 

\v**J 


ha»  »»»«»«*  ntt  nxlmm.  a.  omdltlo  *»«»«» 

as  requiring  that  £ x -S-  o?,  and  again  asking  use  of  the  chi-square 

Hto  1 lira 


distribution. 


»«<M  ’ ** 


(is*1)  • 


(4.34) 


Receiver  operating  characteristic  curves  are  presented  in  Figs.  4.6  aal 
4*7  far  fair  possible  choices  of  n (10s,  lO"5,  10^,  10^),  nnd  in  each  case  for 
throe  values  of  signal  to  noise  ratio  three  db  apart. 

For  large  values  of  n,  the  chi-square  distribution  is  approximately 

a 2 ' 

normal  over  the  centor  portion;  more  precisely,  for  a > > 0 

^CramSr,  Ref.  14,  p.  233*  Tables  of  Snfa2 *)  can  be  found  in  most  bodes  cu  sta- 
tistics. Extensive  tables  are  listed  in  the  bibliography  of  Ref.  l4,  p.  570. 

2p.  0.  Boel,  Introduction  to  Mathematical  Statistics.  ITeU  Tork:  Wiley,  1947, 

p.  246. 
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and 


If  the  signal  energy  is  small  compared  to  that  of  tins  noise, 
unity  and  "both  distributions  have  nearly  the  sane  variance. 


n+s 


is  nearly 
Then  Fig.  4.1 


applies  to  this  case  too,  with  the  value  of  d given  by 


For  these  small  signal  to  noise  ratios  and  large  scales,  thero  is 
sit5>lo  relation  between  signal  to  noise  ratio,  the  number  of  samples,  and  the 
detection  index  d. 


1 “ VbS  *2Jf  f OT  H < < 1 * 

d » 

S*2 


(4.3 


Tvo  signal  to  noiae  ratios,  ( and  £ p)  , will  have  approximately  the  same 


.,/S' 


operating  characteristic  if  the  corresponding  numbers  of  sample  points,  n^ 


and  Dg,  satisfy 


/S\ 


- ENGINEERING  RESEARCH  INSTITUTE  • UNIVERSITY  OF  MICHIGAN 

This  can  he  verified  fop  tins  throe  curves  of  ?ig.  4.7  for  n ■ IfP , compared 
with  Fig,  4.1  fcp  d » 1,  4,  1 6, 

The  rocoivor  specified  In  any  device  that  producos  the  likelihood 


ratio  of  its  input. 


Ax)  ~(i£s)  exp  .mz  £xi2]  • 


An  energy  detector  has  ae  Its  cutimt 


«0(t)  * J J*(t)J2at  - gj  2X± 


and  thjit  receiver  can  be  calibrated  so  that  Its  output  at  the  end  of  tho  obser 
vat  Ion  tine,  e (t),  will  be  read  as 


J(x) 


S ^ 
h«  r 


4,5  Video  Desim  of  a Broad  Band  Rocoivor 


The  problem  considered  in  this  section  is  represented  achematic-JLly 
in  Fig.  4.8.  Tha  signals  and  noise  ore  assures d to  have  passed  through  a band 
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OR  MIXER 
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FILTER 
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VIDEO 

AMPLIFIER 


■POINT  A 


‘POINT  B 


FIG.  4.8 

SLOCK  DIAGRAM  OF  A BROAD  BAND  RECEIVER. 


paas  filter,  and  at  the  output  of  the  filter,  point  A on  the  diagram,  they  are 


sosshpI  to  be  Halted  in 


' tddth  V and  center  frequency 
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<£.>!*•  The  noiac  io  assuaad  to  ho  Gaussian  noiae  vith  & unliWu  spectrum 

2t  2 

over  the  hand.  The  signals  and  aoioo  then  poos  through  a 1 in  jot  detector*  The 
output  o f the  detector  ia  the  envelope  of  the  signals  and  noise  as  they  appeared 
at  point  A;  all  knowledge  of  the  phase  of  the  receiver  Input  is  lest  at  point  5, 
The  signal*  and  noise  no  they  appear  at  point  S are  considered  receiver  input c > 
and  the  theory  of  signal  detectability  is  applied  to  these  video  inpute  to 
ascertain  the  heat  video  desigi  and  the  performance  of  such  a eyston.  The 
iV't-heaetical  description  of  the.  signals  and  noise  will  bo  given  for  the  signals 
and  noise  as  they  appear  at  point  A.  The  envelope  functions,  which  appear  at 
point  B,  will  be  derived,  and  the  likelihood  ratio  and  its  distribution  will  be 
found  for  these  envelope  functions. 

The  only  case  which  will  be  considered  here  is  the  case  In  which  the 
amplitude  of  the  signal  as  it  would  appear  at  point  A is  a known  function  of 
tins. 

Any  function  at  point  A will  be  band  United  to  a band  of  width  W 
and  center  frequency  jf  . Then  the  alternate  form  of  the  stapling  theorem 
can  be  uaed.^  Any  such  function  f(t)  can  be  expanded  as  follows: 

f(t)  ■ x(t)  cos  ut  4 y(t)  sin  cat  (4,1*2) 

where  x(c)  and  y(t)  sire  bond  United  to  frequencies  no  higher  than  ~ , end 
hence  can  themselves  be  eapanded  by  the  saapling  theorem} 

. t (t)  - I |x  ( i)  ^(t)  cos  ca  t * y ( i )^A(t)  sin  <o  t]  . (4.43) 

Ttm  ftmctlcn  can  1*  tkoqgst  of  at  * poiat  in  a space  of  n * 2WI  dlaaaaiona  with 
coordinates  x(g)=  x^  and  y(A) • y*  « fids  is  a rectangular  coordinate 
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system,  since  the  family  of  functions  ^(t)  ccs  «t  and  ^(.t)  sin  wt  fora 
an  orthogonal  system. 

2ha  amplitude  of  the  function  f (t)  is 

?{t)  V[x(t)f  +•  [y(t)]S  [hM) 

and  thus  the  amplitude  at  the  1th  sampling  point  Is 

rf4*)  ■ *1  “•)/  xi  + rl  M5> 


The  angle 

y.  n 

© > arc  tan  -=  * arccos  -=  (fc.W) 

1 *i  ri 

Bight  bo  considered  fb»  jloeo  of  f (t)  at  the  1th  wurjling  point.  The  function 
f (t)  then  night  he  described  by  giving  the  and  rather  than  the  and  yA* 
The  ri  and  0^  are  sample  values  of  amplitude  end  phase,  and  fame  sort  of 
polar  coordinate  system  in  the  apace  associated  vttlx  the  sot  of  functions. 

Lot  ns  denote  by  or  r^,  0^,  the  coordinates  or  sample  values 

for  a receiver  input  after  the  filter  (i.e.,  at  point  A in  ?lg,  h.8).  let 
h1#  or  t±,  denote  the  coordinates  far  the  signal  as  It  vould  appear  at 
point  A If  there  sere  no  noise.  The  envelope  of  the  signal,  hence  the  coor- 
dinates fj,  are  assumed  known.  Let  us  denote  by  Ps{^,  f^)  tits 

I 

distributlcn  function  of  the  phase  coordinates  The  probability  density 
function  for  the  coordinates  x^,  y^  when  there  is  shite  Gaussian  noise  and  no 
slgael  is 

n 

/ l ? T i a/*  4,  »/2  0.1 

%i*.  ri  - (55)  «*  * 3 £ *i  + £ *i ) Mn 

1 i-1  1*1  J 
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and  for  signal  plus  noise 

n 


Changing  to  the  polar  coordinates, 

, i £ a/2 

fH(r*  " (sm/ 


n/2 

n/2 

IW 

r 

(Jti-ai)  + 

I 

d*i 

i«l 

r 

n/2 

1 

ri 

L'2^ 

I 

1*1 

(h.b8) 


n 

, , 2 a/£  f*  r 5 n/2  r 2 2 . Tl 

%(*»»)  • ids'  n 'i/H'sJ  M ■®rA °“  M4 
irt  y l «L  JJ 

a 

®g[^i  4)  * (^*50) 

2WI  2 

The  factors  U t±  are  introduced  because  they  are  the  Jacobian  of  the 
ML 

transformation  frca  rectangular  to  polar  coordinates.1'  2 

The  probability  density  function  for  r alone,  i.e.,  the  density  func- 
tion for  the  output  of  the  detector.  Is  obtained  by  simply  integrating  the  dear 

3 

aity  function  for  r and  9 with  respect  to  9. 

2 x 2*  2* 


i*(r)  * / / — • / fSlri'  8i>  «>  % 

0 0 0 * 

n 

2 a/2  r a/2  t 


2 a/z  r «/«  n 

(I)  ”'i4sf ,'t2 

i-i  *■  i-i  J 


(*.5i) 


framer,  Bef.  14,  page  2P2. 

2 

For  examples,  in  two  dimensions,  t^(x,  y)dx  dy  » f^fr,  ©)  r dr  02. 
^Cmmor,  Bef.  Ik,  page  291. 
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and 


1 


2*  2*  2* 

^(r)  - J f ™ / *&(*!>  «i)  *»*  aV'“d^i 


■{ 


if/n2  -k*Z  iT±+ii>  u 

y ixi  i 1=1  1=1  v y 


ar  1=1 

(if  if  * «*[-£  t *V>1  0. 


i«l 


5£) 


Uotico  that  the  probability  density  fear  r is  completely  independent 
of  the  dintrltutim  i&ich  the  ^ bad;  all  infarmtian  tCxn t the  jfcaac  of  the 
aignela  hen  "been  lost. 

The  likelihood  ratio  for  % rttoo  Input  la 


- apsr  * 9X9 


■* 


si  *»' 


2 


53) 


ML 


AflaJp  it  ia  aoore  canreaiant  to  wart  vith  the  loyiritha  of  the  likelihood  ratio. 

(*.*) 


1 

■S 


•2<r-*/w 


^ - #*» 

*• 


vhinh  la  approximately 


A y{r(t))  - -1«I  J*A 


Pl.56) 
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The  function  IQ(x)  Is  plotted  as  a function  of  x in  Pig.  4.9. 

Thi a function  is  very  nearly  the  parabola  -y  for  aaaH  values  of  x and  la 
approximtely  linear  for  large  values  of  x.  IhuB,  the  expression  for  likelihood 


ratio  sight  he  approximated  by 


£nJ(v(t))  - - ~ + ^ J [r(t)]2  [f(t)]2  dt  (4. 


for  small  signals,  end  by 


A 

£n£(r(t))  m cx  + C2  J r(t)  f(t)  dt 


far  large  signals,  w’ler©  and  Cg  are  chosen  to  approximate  Jn  IQ  beat  in  the 
desired  range. 

The  integrals  la  Eqs  {4.57)  and  (4.58)  can  be  interpreted  as  eroes 
corrslatitc.  Thus  the  optimum  receiver  for  veek  signals  is  a square  lav  detec- 
tor, followed  by  a correlator  which  finds  the  cross  correlation  between  the 
detector  output  and  (f  (t)j2,  the  square  of  the  envelope  of  the  expected  signal* 
For  the  case  of  large  signal  to  noise  ratio,  the  optimum  receiver  is  a linear 
detector,  followed  by  a correlator  which  has  for  its  output  the  cross  correla- 
tion of  .the  detector  output  and  f (t),  the  amplitude  of  the  expected  signal. 

The  distribution  function  for  £(r)  cannot  be  found  easily  in 
case.  The  approximation  developed  bore  viU  apply  to  the  receiver  designed 
for  low  signal  to  noise  ratio,  since  this  is  the  case  of  most  Interest  in 
threshold  studies.  An  analogous  approximation  far  the  large  to  noise 

ratios  would  be  even  easier  to  derive. 


first  we  shall  find  tits  mean  and  standard  deviation  for  the  distribu- 


tion at  the  logarithm  cf  the  likelihood  ratio; 


LN  X.(X) 


(KCo) 
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n/2 

Jn  J(r)  + i X r2ft2 

29  i 1*2  ^ ri  *X  (k.3S 

tor  cano  or  0«U  ^ to  aoIse  Mtlo.  ^ 

for  each  are 

The  notation  %(r±)  and  is  used  to  distinguish  theaa  frco  the  joint 

distributions  of  all  the  * i. 

“Jt  1 5reTlM“*  f,W  «*  %(r).  a. 

I «•  Of  eacn  tw. tatt.  rate Sj  (4.59)1, 

/r.2f2\  f2  o 

^ns?/  t %iv ^ 

o S'  <*•&> 

The  second  aoaent  of  each  tern  S-fL  i- 


i )n»Mw*yk»q4rl  nSr 
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t 1 


&y  « ». 

o 

£ A r 

" wU  7 **  l-'»  J 1 


The  integrals  for  the  caoe  of  noise  alone  can  be  evaluated  easily: 


faVV  *£ 

i\  v/  / a* 

(h\\  £ 

A 16*  I rf 


TLa  integrals  far  tha  case  of  si®»l  plus  noise  can  be  evaluated  In  term  of 
t&o  confluent  hyper geara trie  function,  uhleh  turns  oat  for  the  cnees  above  to 
zeduco  to  a a duple  polynoalel.  The  required  formulas  are  collected  In  conveni- 
ent fora  in  the  hook.  Threshold  Signals  "by  Lavs  on  and  bhlahbeck.^  The  results 


(¥)•  i ^ (■  •£) 

» M'H) 


Since 


<r2(Z)  - ^(Z2)  - [^(Z)] 


the  variance  of 


^ . 

-p-s. 
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'.&>  * 'i  K) 
(¥)-  $ 


f*-65) 


For  the  sum  of  independent  random  variables,  the  mean  1b  the  bub  at 
She  means  of  the  terns  and  the  variance  Is  the  sum  of  the  variances* 
mean  of  /n  jt(x)  is 

. . 1 tx/Z  ? n/^L  fl2  f *1  nfe  t* 

fis n i**A*))  - -all'i+I  z T + Jt'  X I? 

i«a  * J *a 

n/2  1*2  „ 1,2 

^ (/nJ(r))  - - 2 + j I f (1..87) 


acd  the  variance  of  ,/n  ^ (r)  is 


o-2c- (^ai(r))  - 2 


(l  £r*x‘) 

V T**TJ 


2 n/fe  f/ 

ffS  (ii»4r))  • 2 73 


If  the  distribution  functions  /n  -£(x)  can  he  assumed  to  he  normal* 
the  distribution  functions  can  he  obtained  immediately  from  the  aeon  and  standard 
deviation  of  the  distribution.  In  scuo  cates  the  normal  distribution  is  a good 
<fproziaati.cn  to  the  actual  distribution. 
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Lot  us  consider  the  case  in  vhich  the  Incoming  signal  is  a rectangular 
race  »M=h  1.  jf  to*.1  tt.  «.rEr  of  th.  pul..  Is  holf  It.  dorotfcm 

times  the  cnplituda  of  its  envelope,  and  therefore  the  amplitude  hao  the  value 


r m 


(4.5?) 


vhorc  S is  the  pulse  energy.  It  has  this  value  on  M sample  points  and  Is  zero 
at  all  others.  For  this  case 

^ f*«  -w)  * a $r 

ftn  [in  J(v))  - 0 

“"s iV*  J(r>)  - ~s  (x  * i r ) 

«H0  ° 

[l  n jF(r})  « (4.70) 


Also,  far  this  case,  the  distribution  or  i&i(x}  is  approximately 
normal,  if  M is  such  larger  than  cos.  Since  it  is  the  sum  of  M independent 
random  variables,  all  having  the  saaa  distribution,  it  must,  by  the  central 

Q 

limit  theorem,  approach  the  normal  distribution  as  M becomes  large.  The  actual 
distribution  for  the  caso  of  noise  alone  can  be  calculated  in  this  case,  since 
the  convolution  integral?  far  the  fig(r j)  with  itself  any  number  of  times  con  he 


^The  problem  of  finding  the  distribution  for  the  sum  of  H independent  random  vari- 
ables, oach  with  a probability  density  function  f (x)  » x exp  ^ (x24o:2)]lo(0tx) 

arises  in  the  unpublished  report  by  j.  I.  Harcun,  A statistical  Theory  of  Tar  not 
Detection  by  Pulsed  Radar:  Hetheaatical  Appendix,  Projoct  Hand  Beport  H-113- 
Hamsa  gives  an  exact  expires  ion  far  this  distribution  vhich  is  useful  only  far 
small  values  of  H,  and  an  approximation  in  Gram-Charlier  series  vhich  is  sore 
accurate  than  the  normal  approximation  given  here.  Marcum's  expressions  could  he 
qaod  in  this  case,  and  in  the  case  presented,  in  Section  4.6* 

^Crnmor,  Hcf.  14,  p.  213  and  315,  ^Cituaor,  Hof.  14,  p.  188-9. 


-fc  • Wi 

/.:s;  - 
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oxpreBSod  In  closed  fora.  The  density  function  far  this  distribution  is 
plotted  in  Tie*  **.10  for  severs!  relatively  anal!  values  of  X.  The  distribution 
off  j£n  Mx)  for  eichal  plus  noioe  is  acre  nearly  narnal  than  the  distributlu\ 
for  noise  alone,  since  the  distributions  are  sere  nearly  normal  than 

%(ri>* 

The  receiver  operating  characteristic  for  the  case  X » Ifi  is  plotted 
in  Fig.  4.11  using  the  narnal  distribution  as  mroyoxiaation  to  the  true  distri- 
bution. In  many  cases  it  will  be  found  that 


1 SB 
X * 


<<  1 


(4.71) 


In  such  a case  the  distributions  have  apprccdHately  the  same  variance.  Assaying 


nornel  distribution  than  leads  to  the  curves  of  Tig,  4.1,  with 

4 * m ) - 


pf.ia) 


4.6  A Radar  Case 

This  section  deals  with  detecting  a radar  target  at  a given  range. 
That  is,  we  shall  as  suae  that  the  signal.  If  It  occurs,  consists  of  a train  of 
H pulses  whose  tins  of  occurrence  and  envelope  shape  are  boom.  The  carrier 
phoso  will  be  assumed  to  have  a uniform  distribution  for  each  pulse  independent 
of  all  others,  i.e.,  the  pulses  are  incoherent. 

The  set  of  siguCLs  can  be  described  as  follows: 


aft)  * £ f(t*»T}  cos 

*■0 


(*.73) 


whore  the  X angles  ©^  have  independent  uniform  distributions,  and  the  function  t, 
which  is  the  envelope  of  a single  pulse,  has  the  property  *4** 
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/ f(t+ir)  f (t+J  r ) dt  * ~ , (4.74) 

0 

vuoro  8 is  the  Kronockor  delta  l*unction,  vhich  la  zero  If  i jf  J,  sud  unity 
if  i * J.  The  time  T is  the  interval  between  pulnos.  £q  (4.74)  states  that 
the  pulses  are  spaced  far  enough  so  that  they  aro  orthogonal,  and  that  the  total 
signal  energy  is  E.1  The  function  f (t)  is  also  assuned  to  have  no  frequency 
components  os  high  as  ^ . 

The  likelihood  ratio  can  he  obtained  by  applying  Eq  (3«7)» 

-/(^)  * J exp  s(t)  x(t)  arj  d?g(s)  (4.75) 


_ 2*  2*  _ ^ H-l 

- j ®®|jr  / J'a  f (t-fn.T)x (t )ccs C«*t+9^)dt 


«*  exp; 


a8o",aVi 


(V.76) 


The  integral  can  be  evaluated,  as  in  Section  4.3,  end 


where 


./w  - «*»  [-  Jj]  n *.  (»?) 


(^•77) 


f (t-w  t )x  (t)cos  vi  tdt 


Mi/ 


f (t+*T)  x(t)sinutdt  J (4.78) 


1 


0 0 

This  quantity  r is  a Inoat  identical  with  the  quantity  r which  appeared 
s 

in  the  discussion  of  the  case  of  the  sigul  known  except  for  carrier  phase. 
Section  4.*.  Xa  fact,  each  ra  coul d be  obtained  is  * xuoeiear  in  the  wanner 


%he  factor  2 appears  in  (4.74)  because  f (t)  is  the  pulse  envelope;  the  factor  H 
appears  because  the  total  energy  E is  M tines  the  energy  of  a single  pulse* 
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described  in  that  section.  The 


j t0  is  connected  vith  the  first  pulse; 


it  could  he  obtained  by  designing  t deal  filter  for  the  signal 

eo(t)  « f(t)  cce  iut+e) 


£4. 79) 


for  any  value  of  the  phase  angle  9,  and  putting  the  output  through  a linear 

dat^tor.  H»  output  Hill  1»  5p  5®  «*  •«»  1“t“*  of  tl»  t.  *Mch  X,  fetar- 

mined  hy  the  time  delay  of  the  filter.  The  other  quantities  ra  differ  only  in 

that  they  are  associated  vith  the  pulses  which  come  later.  The  output  of  the 

filter  at  time  L tor  will  be  5k  3l  „ 

. 2 M 

It  is  convenient  to  have  tbs  receiver  calculate  the  logarithm  of  the 


likelihood  ratio. 


Jn  J(x)  » -1.+  X 

**0  S«4 


(4.80) 


Thus  the  j^n  IQ  must  be  found  far  each  ra,  and  these  M quantities  must  be 

x 

added.  As  in  the  previous  section,  JB  will  usually  be  small  enougi  so  that 

Jn  IQ(x)  c*n  be  approximated  by  ^ The  quantities  ^ ( ~)  can  be  found 

by  using  a square  law  detector  rather  then  a linear  detector,  and  the  outputs 

of  the  square  law  detector  at  times  V VT,  tc  + (M-l)r  then  must  be 

added.  The  Ideal  ayBtem  thus  consists  of  an  i.f.  amplifier  vith  its  passband 

* 

matched  to  a single  pulse,  a square  lev  detector  (for  the  threshold  signal 
case),  and  an  integrating  device. 

Vs  shall  find  juxml  apprcaimatiana  for  the  distribution  functions  of 


the  logarithm  of  the  likelihood  ratio  using  the  approximation 


&J6L) 


13ee  Pig.  4.9. 

2It  la  usually  most  convenient  to  soke  the  ideal  filter  (or  an  approximation  to 
it)  a part  of  the  i.f.  amplifier. 

— 4a  — _ 
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vhlch  is  valid  fop  snail  values  of  -S  f ^ 


O *ML  , , r \2 

/»*•-#-♦  2 M^)  . 


o a»o 


(4.8S) 


The  distributions  far  the  quantities  ra  are  independent;  this  foil cvo  free  the 
fact  -that  the  individual  pulse  functions  f(t-Haf)  cos  (ui  t+©a)  are  orthogonal. 
The  distribution  for  each  is  the  sam  as  the  distribution  far  the  quantity  r 
vhlch  appears  in  the  discussion  of  the  oi^vol  known  except  far  phase;  the  same 
analysis  applies  to  both  cases.  Huts,  by  £q  (4.22)® 


and  by  (4.26), 


h{%M *•)■  4f) 

pi(r 4*)  ■ * 


Ms) 


J The  density  Amotion*  can  be  obtained  by  differentiating  (4.8j5)  and  (4.34)  i 

hCfh 

’-ft)*#)]  * 

aa(£)- 

3Boe  footnote  1,  p.  JT. 

^The  11  appears  In  the  following  equations  because  the  energy  of  a single  pulse  is 
§ rather  than  B. 

w* » 


la  order  to  obtain  approximate  results  far  the  remaining  two  cases,  the 
aa sumption  la  made  that  In  these  cases  the  receiver  operating  characteristic 
can  be  approximated,  by  the  curves  of  Fig*  fc.l,  i.e.,  that  the  logarithm  of  the 
likelihood  ratio  is  approximately  normal.  This  section  dlecusses  the  approxi- 
mation end  a method  for  fitting  the  receiver  operating  characteristic  to  the 
curves  of  Fig.  J**l« 

It  vbs  pointed  out  in  Section  2*5*1  of  Part  I of  this  report  that 
Fgg(/)  can  be  calculated  if  Fg(jC)  ia  known.  It  was  further  pointed  out  that 
the  moment  of  the  distribution  is  tho  (h-1)***  moment  of  the  distri- 

bution F^{(v^).  Hence,  the  wean,  of  tho  likelihood  ratio  with  noise  alone  is 
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unity,  end  if  the  variance  of  the  likelihood  ratio  vith  noise  alone  is  ojj  , the 
second  ament  vith  noise  alone,  and  hence  the  mean  vith  signal  plus  noise  Is 

O 

1 + * Thu-i  the  difference  between  the  means,  end  the  variance  vith  noise 

A 

alone  are  the  same  number  <r^  . This  nmber  probably  characterizes  the  receiver 
reliability  better  than  any  otter  single  number. 

Suppose  the  logarithm  of  the  likolihood  ratio  has  a normal  distribution 


vith  noise  alone,  l.e.. 


1 

y^d 


CO 

/*  exp[-^^-]to,  (*.87) 

<£nZ 


vhore  a is  tha  mean  and  d the  variance  of  the  logarithm  of  the  likelihood  ratio* 
The  n^h  moment  of  the  likelihood  ratio  can  bo  found  as  follows: 

to  to 

m J 2n  dFa(2)  « -~=  / exp[nx]exp[-  -fo-p-]  dx  , (*.88) 

q v 2*d  .(0 

vhoro  the  substitution  /«  exp  x has  been  made.  The  integral  can  be  evaluaved  by 
completing  the  square  in  the  exponent  and  using  the  fact  that 

f •*>[-&  ]to  . ysr  , 


« «p[  ?jr + m ] • 

In  particular,  the  mean  of  vhlch  must  be  unity,  is 

/**(•£)  « l » Wp[  | + 3 ] , 

and  therefore 


1 M 2 

The  variance  of  Jt(x)  vith  noise  alone  is  <r^  , and  therefore  the  second 


(*•90) 


(*•52.) 


#*■>“  •a.-.*;-  . ik  V‘  . 

* * * ■ t*.  * ; - 

" r ^ "’’s  - -•  --y 


a 
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of  X(x)  ie 

Mu(-*2)  - )J2  + O’/CO  - 1+flr/t**)  , (4.?e) 

and  this  aost  egree  vlth  (4.89). 

/xN(-d2)  - 1 + <rN2  - exp  [2d  + 2m]  « exp[d]  <4.93) 

and  there fora 

d » Jn  (1  + <rH2)  . (4.94) 

The  distribution  of  likelihood  ratio  with  signal  plus  noise  can  be 
found  by  applying  Thsoran  8.* 

®gK(-0  - , ' 

Tgj»(<^)  * • j • (*»S5) 

M 

Substituting  far  F^(/ ) from  (4.87),  and  lotting  X - exp  x yields 


Thus  the  distribution  of  JnjL  is  normal  also  when  there  le  signal  plus  noise,  in 
this  case  vlth  assn  - and  variance  d. 

o 

In  sunsary,  the  variance  <r^  of  the  likelihood  ratio  probably  neasuree 
the  receiver  reliability  better  than  any  other  0 ingle  nunber.  if  the  logarigfln 
of  the  likelihood  ratio  has  a normal  distribution,  then  this  distribution,  and 


1 

See  Part  I,  Section  2.4. 


r 
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2 

hence  the  signal  plus  noise  distribution,  are  completely  deterainod  If  cr * 

Is  given.  Both  distributions  of  Xu  X(x)  are  normal  vith  the  saae  variance  d, 
md  the  difference  of  the  means  is  d.  The  receiver  operating  characteristic 
curves  ore  those  plotted  in  Fig.  4.1,  vith  the  parameter  d related  to 


by  the  equation 


d **  Xu  (1  + er^2) 


(4.94) 


m the  case  of  a signal  known  exactly,  this  is  the  distribution  vhich 
occurs.  In  the  cases  of  Section  4.4,  Section  4.5,  and  Section  4.6  this  distri- 
bution is  found  to  be  the  limiting  distribution  vhen  the  number  of  sazqxlo  points 
is  large.  Certainly  in  most  cases  the  distribution  has  this  general  font.  Thus 
it  seems  reasonable  that  useful  approxisnte  results  could  be  obtained  by  calco* 
lating  only-  <r  2 for  a given  case  end  assuming  that  the  receiver  reliability  is 

It 

approximately  the  same  as  if  the  logarithm  of  the  likelihood  ratio  had  a normal 
distribution.  On  this  basis,  0^  (X)  is  calculated  in  the  following  sections 
for  tvo  cases,  and  the  assertion  is  made  that  the  receiver  reliability  is  given 
approximately  by  the  receiver  operating  characteristic  curves  of  fig.  4.1  with 
d « ./n  (1  ♦ <rH2}. 


The  following  case  has  several  applications,  vhich  be  discussed  in 
Section  5.5.  The  importance  of  this  cose,  and  the  one  vhich  follows  It,  lies  in 
the  fact  that  the  uncertainty  of  the  signal  distribution  can  be  varied  by 
changing  the  pe  remoter  K. 

Suppose  that  the  set  of  expected  signals  Includes  Jmt  Jt  artheyj 
functions  ^(t),  all  of  vhich  have  the  same  probability,  the  sans  energy  S,  and 


r .4 


£ 'U  ■ 

Ktv- 


>»*•**-  *>  w„"W,«i„flii  40ft'!4',k&iiVfc<>«i 
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It  follow  that  tho  mean  of  each,  tern  Is  unity,  and  the  variance  la 

<r/(Z)  ■ - f^(2)  2J-  esp^J  . i . (4.100) 

Tho  variance  of  a sun  of  independent  »r,2cB  voriablee  ia  the  bus  cf  the  variances 
of  the  terms.  Therefore 

lr)  - *]  * ej») 

end  It  follows  that  the  variance  of  the  likelihood  ratio  is 

“'/<•*>  • s[“p(f ) •*]  * <*•**> 

It  was  pointed  out  in  Section  4.7,  47  that  the  receiver  operating 

characteristic  curves  are  apprcccimtely  thoee  of  Figure  4.1,  with 

a * jtn  (1+  o r*i  - /n  - | + i exp  (|£ 

2S 

This  equation  con  he  solved  for  =-  i 

fjj  " ^ ♦ 11  * *)  J * (4.104) 

Curves  of  ~ for  constant  d are  plotted  in  Pig.  4.12.  They  ahow  how  much  the 
"o 

signal  energy  &ust  he  increased  when  the  nunber  of  possible  signals  increases. 

4,9  Signal  Which  is  cme  of  M Orthogonal  Signals  with  ttoknown  Carrier  Phase 

Ccpslder  the  case  in  which  the  set  of  expected  signals  includes  jost 
M different  amplitude  nodulated  atgoele  which  are  known  except  tear  cmrrl&r  phase. 
tens**  the  signals  by 

ex(t}  » fk(t)  cos  (a* t + «}  . (4.105) 


» 


(4005) 


H 


:(M^) 


< * 

M exp^ 
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2.  SIGNAL  ENERGY  AS  A FUNCTION  OF  M ANO  d 
SIGNAL  ONE  OP  M ORTHOGONAL  SIGNALS. 
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It  vHl  be  assured  further  that  the  functions  fj,(t)  all  ham  the  woe  energy  2 
arid  are  orthogonal,  i.e., 

rT 

J *k(t)  f9(t)  at  - 228^  , (^.106) 

whore  the  2 is  Introduced  because  the  fa  are  the  signal  amplitudes,  not  the 
actual  signal  functions.  Also,  let  the  f.(t)  ho  band-limited  to  contain  no 
frequencies  as  high  as  a.  Then  it  follows  that  any  two  cignal  functions  with 
different  envelope  functions  will  he  orthogonal,  let  us  assure  also  that  the 
distribution  of  phase  G la  uniform,  and  that  the  probability  for  each  envelope 
function  is  ~ . 

A 

With  these  assumptions,  the  likelihood  ratio  can  he  obtained  fren 
Eq  (5.7),  and  It  Is 

Vfcl  * Sj]  69 

where  are  the  sample  ralues  of  s^ft),  and  hence  depend  upon  the  phase  0. 

The  integration  is  the  sore  as  in  the  case  of  the  signal  known  except  far  phase, 
and  the  result  can  be  obtained  free  Eq  (4JL9) 

X 

J(x)  “ ^°xp{“  * ^*108^ 

■where 

xl  W coet*,ti)2  + ( X **(**)  oin  utif  * (4.109) 

Har  the  problem  is  to  find  <TJT[j£).  The  variance  of  -each  tern  .in 

" ■ 

the  mat  in  Eq  (%.lo9)  can  be  found,  since  the  distribution  function  with  noise 
alone  can  be  found  ae-  in  Section  4,5*  Since  the  f^(t)  are  orthogonal,  the 
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aictributicna  of  tho  r^.  are  independent,  and  the  terns  in  the  am  in  Bq  (4.107) 
ere  Independent.  Then  tho  variance  of  the  livelihood  ratio,  ia  the 

am  of  the  mrianceo  of  tho  tenna,  divided  by  If*.  * 

She  distributifin  function  for  each  torn  exp  |-  jL  IQ(~)  ia  given 
in  Sectim  4.3  by  Eq  (4.21)  and  (4.22).  If  a ia  defined  by  the  equation 


0 « exp 


(4.10 


then  the  distribution  function  in  the  presence  of  noise  far  each  in 
£q  (4jlo6  ) u 


10)  « exp 


[-#]■ 


(4,11] 


The  tan  value  of  each  term  la 


#»Mw 


Chia  can  be  evaluated,  and  the  result  ia  that  /fc**'(0)  « L. 
9»  eec  end  Qdacst  of  each  tens  la 
<0 

- / p2  ®,w») 


! 


^Lovoan  and  Uhlonbech,  Bef.  1,  p„  xjb 
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The  integral  Is  evaluated  in  Appendix  E,  and  tie  result  1* 

W)  - i„(r)  . <*• 


The  variance  is 


<*•“» 


It  follcvs  that  the  variance  of  M 1 is 


»<■*>  - 


(4ai6) 


^7) 


since  the  variance  for  the  sun  of  independent  rand  on  variables  is  the  sun  of  the 
variances* 

If  the  apprexiaatien  d'.urrthed  in  Section  h.J  is  used,  the  receiver 
operating  chamct  eric  tic  curves  are  appimimtely  those  of  Tig.  %«1#  vlth. 


d « /a  pL  + o Tjj2)  » /a 


(*-1*1*05)). 


(H.113) 


Curves  of  g va  K for  constant  d are  plotted  iaEig.  *45- 


FIG*  4.13.  SIGNAL  ENERGY  AS  A FUNCTION  OF  M AND  d 
SIGNAL  ONE  OF  M ORTHOGONAL  SIGNALS 
KNOWN  EXCEPT  FOR  PHASE 
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>.  DISCUSSION  d*  TES  SPECIAL  CASES 


5«1  Beceiver  Evaluation 

5*1*1  Introduction.  Id  Section  2.5  it  was  shown  that  the  receiver 
reliability  can  be  determined  free  the  distribution  functions  for  nvwtfonga 
ratio.  In  particular  an  optimum  criterion  receiver  operating  at  the  level  p of 
likelihood  ratio  has  false  alarm  probability  ?h(A)  * and  probability  of 

detection  Psk(A)  * FSK(0).  The  functions  and  y^O)  are  calculated  in 
| Section  k for  a rancher  of  special  cases* 

For  the  purpose  of  discussing  receiver  reliability  It  is  sufficient  to 
hare  the  receiver  operating  characteristic  in  -which y_te)  ia  plotted  as  a 
function  of  y_(p).  In  this  discussion  p plays  only  a secondary  rede* 

i ™ 

Ihe  receiver  operating  characteristic  shown  in  Figure  5*1  applies  to 

I 

several  cases*  Among  them  is  the  case  of  the  signal  known  exactly,  with  tbs 

parameter  a equal  to  , twice  the  ratio  of  signal  energy  to  noise  power  per 
1 W° 

unit  bandwidth.  Thus,  for  example,  if  the  signal  is  a voltage  which  Is  a known 
function  of  time,  and  if  the  signal  energy  is  twice  the  noise  power  per  unit 

i 

| bandwidth,  theoretically  a receiver  could  be  bunt  with  false  alarm  probability 

I of  0.25  end  a probability  of  detection  0*90*  If  the  Alee  alarm  probability  Is 

! 

required  to  be  no  greater  then  0.10,  the  probability  of  detection  can  be  made  no 
greater  than  0.76.  If  the  false  alarm  probability  is  required  to  be  no  greater 
than  0.023  end  the  probability  of  detection  is  to  be  at  least  0.53,  the  signal 
energy  must  be  at  least  eight  times  the  noise  power  per  unit  bandwidth* 

3.1.2  Comparison  of  the  Simple  Cases*  Several  curves  for  the  case  of 
a signal  known  except  for  phase  are  shown  in  Fig.  5*2  for  some  of  the  sane  values 

*See  Section  4*2, 
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of  t ho  ratio  xr-  os  appear  in  Pig.  54..  The  curves  for  a given  energy  lio  bolow 
*0 

those  for  the  case  of  the  oicjml  known  exactly;  vith  a given  ft&oe  alarm 

probability  ana  & given  value  of  , one  cannot  achieve  aa  high  a probability 

"o 

of  detection  if  tbs  carrier  phase  of  the  signal  is  unknown. 

It  was  found  that  in  several  cases  the  distribution  of  Jn  J(x) 
approached  & normal  distribution  as  a Halting  case,  and  that  in  tho  limit  the 
variance  vith  signal  plus  noise  and  the  variance  with  noise  alone  ere  equal. 

In  any  such  ease  the  curves  of  Fig.  5.1  apply,  and  a comparison  of  those  cocos 
is  simplified.  For  example,  in  the  caoo  of  a signal  which  is  a sample  of  white 
Gaussian  noise,  it  was  found  that  if  the  number  of  sample  points  is  large  and  the 


sigMl  to  noise  ratio  la  snail,  then  this  approximation  applies,  with 


^4vg)"  § (if  • 


(4.37) 


Other  curves  For  this  case,  coca  with  small  sample  number  and  moderate  signal 
to  noiee  ration  are  given  in  Figs.  4.6  end  4.7.  The  exact  equations  for  the 
distribution  are  Eqa  (4.55)  and  (4.54). 

The  following  two  cases  lead  to  the  same  receiver  operating  charac- 
teristic in  the  approximation  considered  in  Sections  4.5  and  4.6:  (1)  the  broad 
bend,  receiver  vith  optima  video  deoi®i,  with  a pulse  signal,  and  (2)  the  optimum 
receiver  for  a train  of  pulses  with  incoherent  phase.  In  the  first  case  the 
parameter  H ves  taken  as  the  product  of  the  total  bandwidth  of  the  receiver  and 
the  pulse  width  of  the  signal.  In  the  case  of  the  train  of  pulses,  M is  the 
number  of  pul  sen.  Xa  each  caso  £ is  the  total  energy  of  the  signals.  Approxi- 
mate receiver  operating  characteristic*  are  plotted  in  Fig.  4.10.  Small  signal, 
to  noise  ratio  and  large  K lead  to  the  distributions  for  which  Fig.  5*1  Is 


i . — . 
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plotted,  this  tine  vith 

*■«?)*  • <*•*> 
$.1,3  An  Approxlsato  Svaluation  of  Optimum  Receivers.  Soao  simpler 
evaluation  of  receivers  ves  seeded  ’because  of  the  difficulty  la  solving  directly 
far  the  distribution  function  of  likelihood  ratio  in  any  eases  oaro  complicated 
than  the  ones  already  Mentioned.  It  eeenod  reasonable  to  approximate  the  actual 
receiver  operating  characteristic  by  the  curves  given  la  Fie*  5.1#  finding  la 

4 

" acne  naxaer  the  value  of  the  detection  index  d vhich  loodr.  to  the  boot  fit  of 

the  approximate  curve  to  the  real  curve.  This  is  suggested,  by  the  occurrence  of 
the  curses  of  Fig.  $.1  in  four  of  the  five  cases  already  diucuneod.  Also,  any 

t 

receiver  operating  characteristic  oust  have  In  casncn  vith  the  curvet  of  Fig.  5*1 
that  its  elope  is  positive  end  Its  second  derivative  is  negative,  and  that  it 
oust  start  at  the  lower  loft  hand  corner  and  end  at  the  upper  right  hand  earner 
« of  tbs  graph. 

It  is  shown  in  Section  2*5.2  that  the  variance  of  the  likelihood 
ratio  uhea  there  is  noise  alone  is  the  sano  as  the  difference  of  the  aeons  of 
likelihood  ratio  vith  noise  Slone  and  vith  signal  plus  noise*  Shis  larruaster 

O 

<rg  eeecs  to  characterize  riffsaX  detectability  better  than  any  other  single 
maker.  In  Section  fc.7#  it  is  shown  that  if  o^i 2  1b  given  end  the  logpudthn  of 
the  likelihood  ratio  is  assumed  to  have  a nornal  distribution  vith  noise  alaoo, 
then  it  follows  that  the  loguritfcn  of  the  likelihood  ratio  vith  sisal  pins 
noise  also  has  a accrual  distribution  vith  the  seas  variance,  and  thus  the 
recefvar  operating  characteristic  is  that  of  Fig.  5^1.  The  index-  <f  is  given  by 

4 - Jn  ( 1 + o r^2)  i,  £^*9^ 


i 

§ 
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2 

It  seems  reasonable  ttat  tfi#  curves  be  fitted  ca  this  basis,  i.e. , that  «r^ 
l>e  determined  for  tho  actual  situation,  and  the  appreotiaa-  e receiver  operating 
characteristic  graph  be  to&P  as  the  curve  of  Pig.  5*1  vith  index  d given  by  the- 
above  25  (4.34). 

•i.i.li  The  sicnai  One  of  M Orthogonal  Signals.  The  methods  of  the 


previous  section  have  been  applied  to  the  case  where  the  operator  knows  that  the 
signal,  if  it  occurs,  will  b®  one  of  H orthogonal  functions  of  equal  energy. 
Orthogonal,  of  course,  moa nS  that  the  functions  have  zero  cross  correlation,  i.e., 
f(t)  and  g(t)  are  orthogonal  it 


m 

j f (t)  c(t)  at  » 0 


(5.1) 


vhere  the  integration  is  over  the  observation  Interval.  The  value  obtained  for 


*1  1,1 


sH?)*1] 


(4.102) 


and  so  the  approximate  receiver  operating  characteristic  is  that  of  Pig.  5.1  with 


(4.103) 


The  value  of  ar^  was  also  found  far  the  case  where  each  of  the  M orthogonal 
signals  Is  known  except  for  jiliaae,  and  the  phase  angle  has  a uniform  distribution! 


Per  this  cam 


, and  hence 


(4017) 


(4.110) 


^Seo  Section  %ea  SddtiMfc 
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These  tvo  cases  ore  the  "basis  far  tie  "best  approximation  available  to 
the  probltta  of  a sicnal  of  unknown  tine  origin  or  a sicnal  of  unknown  frequency 
or  both*  For  example,  we  have  been  unable  to  find  the  distribution  of  likelihood 
ratio  for  tho  case  of  a oigial  which  is  a pulse  of  unknown  carrier  plsaoe  if  the 
starting  time  is  random  and  distributed  uniformly  over  a tine  interval.  However, 
if  the  problem  is  changed  slightly,  oo  that  tbs  starting  tins  is  restricted  to 
tines  spaced  approximately  a pulse  width  apart,  then  pulses  starting  at  different 
tinea  would  be  approximately  orthogonal,  and  the  case  of  the  signal  one  of  M 
orthogonal  signals  known  05c opt  for  phase  could  be  applied.  Eq  (4.11B)  should 
be  used  with  H equal  to  tho  ratio  of  observation  time  to  pulse  width.  A stnilar 
arguBont  applies  to  tho  case  In  which  a signal  is  a pulse  known  oxcept  for  phase 
and  center  frequency.  Eq  (4.118)  should  bo  used  with  11  taken  as  the  ratio  of 
total  bandwidth  to  oigial  bandwidth.  It  should  be  pointed  out  that  it  Is  not  the 
sane  to  assume  that  the  signal  con  appear  in  only  & finite  number  of  different 
positions,  ovun  though  tho  positions  ore  cl  cue  to  each  other,  as  to  say  that  the 
sl&ial  can  appear  anywhere  in  on  Interval.  There  is  more  uncertainty  in  the 
latter  cose,  and  the  signal  cannot  be  detoctod  os  cosily. 

45  ?h°  Broad  Band  Becolver  and  the  Ideal  Racolvur.  toe  canon 
method  of  detecting  pulse  slpuilg  in  a frequency  bond  is  to  build  a receiver 
whose  bandwidth  is  the  entire  frequency  band.  The  receiver  operating  character- 
istic fear  such  a receiver  with  a pulse  sigial  of  known  starting  time  la  cal- 
culated in  Section  4.4.  This  Is  not  a truly  ideal  receiver,  and  it  would  ha 


interesting  to  Caspars  it  with  an  ideal  receiver.  This  can  be 


using  the 


approximation  of  the  procoding  paragraph  for  the  ideal  receiver.  Since  the 
; bandwidth  of  a pulBe  is  approximately  tho  reciprocal  cf  the  pulso  width,  the 
! parameter  11  of  Section  4.4  and  tho  parameter  11  in  Eq  (4.118)  aro  both  equal  to 


— 61 


Wk  I 


I 

1 ’ 


— ENGINEERING  RESEARCH  INSTITUTE  • UNIVERSITY  OF  MICHIGAN  - 

the  ratio  of  to  tel  ‘bandwidth  to  pulse  bandwidth.  Cartes  Sharing 
function  of  d are  given  in  Mg.  5.3  Sot  the  apprcodtmte  ideal  receiver  and  the 
broad  band  receiver  fear  several  wine*  of  M.  She  expression  toed  f or  d is 
Eu  (4.71)  which  holds  for  largs  raloee  of  K. 

^.1.6  TSacertainty  and  Signal  Setectabillty.  3h  tha  two  eases  dis- 
cussed in  Section  5.1A,  where  the  sifpal  ccnaidered  is  ona  of  M orthogonal 
signals,  tfco  uncertainty  off  ths  signal  is  9.  function  of  K.  This  gives  us  an 
opportunity  to  study  ths  effoot  in  these  two  cases  of  uncertainty  on  signal 
detectability.  In  the  ropKadnate  evaluation  of  the  receiver  huilt  to  detect  the 
preeenco  of  a signal  vhm  the  signal  is  era  of  K crtkogoml  fcaetinaa,  the 
curves  of  Tig.  5.1  are  unod  with  the  detection  index  d given  1st 


‘H'l-Cf)] 


(%.icg) 


This  equation  can  he  solved  for  the  energy. 

—•  • In  fl  - H + Ms4] 

*0 

» In  * +Xn  (o4-l)  , (5.2) 

the  ajrprarixatlon  holding  for  IsigB  5/  this  equation  it  esn  ho  seen 
that  the  signal  energy  Is  ajjumiaately  a linoor  function  off  In  H when  the 
detection  index  d,  and  hence  the  ability  to  detect  signals,  is  JDept  constant.2 


^If  W->  3$  the  error  is  less  then 
2 

It  night  be  suspected  that  ^ is  & linear  function  of  ths  entropy  « - £ 

TS&5®*  :P-i  "<theijBBffl8dilIB^'  wof  'the  iff*®1  rerthpgonel  ;sijpsxL.  'ffhin  ao  3^4  t&e  csee, 

***  e®*1‘  czprcsaim  nBffcfcoccuro  in  this  rare 


‘ f ‘ 


' Jt /SfiUi'V 


.w  . 1.  in#*  '•  i*  •*!>•>**** 
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5.2  Beceitgr  Deaifgu  There  are  a few  cases  when  tho  receiver  design  ia  siqple 
to  rpecify  if  the  noise  is  Gaussian.  If,  for  example,  not.  only  the  noise,  but 
Alan  the  sig pel  ore  Gaussian,  and  both  have  a uniform  spectrum  tnrer  their 
bandwidth,  then  tho  optimum  receiver  slssly  ssasurea  the  energy  which  cocoa  in 
during  the  observation  period.  The  cicule  relation  between  energy  and  liveli- 
hood ratio  is  given  by  Eq  (fc.fcl)  of  Section  k.h* 

She  simplest  remaining  cam  is  that  in  which  the  signal  is  known 
exactly.  the  theory  specifies  that  tss  receiver  find  the  cross  corre- 

lation between  tho  expected  a*  gw il  and  the  receiver  input,  l.e.. 


»{t)  x(t)  at. 


(5.3) 


wiwsre  a(t)  Is  the  expected  signal  and  x(t)  la  the  receiver  input,  and  the 
observation  interval  is  fron  t » 0 to  t » I . The  ratio  c?  this  cross  correlation 
to  the  noise  power  per  unit  bandwidth  is  one-half  the  natural  logarithm  of  the 
likelihood  ratio.3'  Severn!  elaborate  correlating  devices  havo  been  built 


recently. 


Share  is,  in  this  case,  a sir?Ie  aeano  of  obtaining  tho  correlation. 


if  the  signal  is  olqplo  in  fan,  for  exeeple,  a pulse.  If  a filter  can  be 


designed  with  impulse  response 

h(t)  - s(T-t) 


If  0 St&T  , 
otherwise. 


(V.10) 


and  the  receiver  input  applied  to  the  filter,  then  the  output  at  tine  T will  be 


3Soe  page  9,  Eq  (V.Xb). 

?Ear»togtaa ; and  £ogor%  iE  a£ . il4;  Jftudltec  tasfc  Heed*,  Betf.  if;  Sen  gSaatBaafr  oath 
Wiesaoer*  BsfL  iff;  Levin  and  R&ihtses*  Bef.  X9. 


f 
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T T 

J x(r)  h(T-r)  dr  • J x(r)  s(r)  dr  , (^*11) 

-<D  0 

vhich  is  the  required  correlation*  It  turns  out  that  this  Is  the  save  filter 
specified  by  Middleton,  Yaa  Tieek,  Wiener,  Worth,  and  Hansen  aa  the  filter  vhich 
maximizes  aignal-to-noiee  ratio.*1 

If  the  signal  being  sought  is  an  amplitude  modulated  signal  known 
except  for  carrier  phase,  than  the  Ideal  receiver  has  a filter  like  the  one 
specified  In  the  previous  paragraph  designed  far  any  particular  phaae.  The 
receiver  input  la  applied  to  this  filter,  and  the  output  is  an  rf  (or  Bare 
likely,  if)  voltage.  It  turns  out  that  the  envelope  of  this  voltage  la  the 
roquirod  quantity.  Its  rolation  to  likelihood  ratio  is  derived  in  Section  4.3 
and  presented  in  Bqa  (4.19)  and  (4.29). 

A look  at  the  general  equation  for  likelihood  ratio 

jt(x)  - Jlx p|--a  / *(t)  ®(t)  dt  J dPs(e)  . (3.7b) 

a o 

suggests  the  following  method  for  designing  the  optima  receiver  for  algal 
detection,  first  find  the  correlation  as  described  Above,  between  the  reoeiver 
input  and  each  possible  expocted  signal.  Wert,  divide  each  by  the  noise 
per  unit  bandwidth,  and  find  the  exponential  function  of  each.  Finally,  find  the 
veigfrtod  average  of  all  those  quantities.  The  hard  part  is  to  find  tbs  cross 
correlation  botveen  each  expected  signal  and  the  receiver  input.  This  means 
that  the  ideal  filter  and  associated  amplifiers  axe  needed  for  each  expected 
signal,  or  essentially  a separata  receiver  far  each  expected  sl&nl.  In  moat 

\avscn  and  ’Jhlonbeck,  Hof.  1,  p.  206;  Worth,  Kef*  H.  I 
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cases  this  is  out  of  the  question.  In  tho  cases  studied  in  Sections  4.2,  4.3, 
4.4,  and  4.6,  sene  peculiarity  of  tho  sot  of  expected  signals  nods  a stapler 


ideal  receiver  pooclblo. 

There  is  another  noteworthy  cose.  If  the  signal  is  known  except  for 
starting  tiro,  then  it  is  sufficient  to  look  at  tho  saae  idoal  filter  at  dif- 
ferent tiros  rather  than  to  have  a different  filter  for  each  starting  tiro. 

For  even  a stable  square  pulse,  it  is  impossible  to  synthesizo  the 
ideal  filter  exactly,  just  how  critical,  then,  is  the  design  of  the  ideal 
filter!  This  can  ho  answered  by  finding  how  veil  signal  detection  con  he  accoo< 
plished  with  an  approximation  to  the  ideal  filter. 

Tor  simplicity,  consider  the  coso  of  the  signal  known  exactly.  The 
results  for  this  will  follow  with  little  codification  far  the  other  cases  where 
the  ideal  filter  is  used.  The  theory  specifies  that  the  response  of  a certain 
filter  to  the  receiver  input  he  observed  at  a certain  instant.  Once  it  is  known 
that  the  ideal  receiver  has  this  form,  it  is  dear  that  this  filter  root  he  the 
one  which  roxiaizea  the  instantaneous  signal  output  voltage  (or  power},  the  noise 
ras  voltage  (or  average  pevor)  being  kept  fixed.  This  is  the  reason  the  filter 
which  other  anthers  have  found  roxiatzes  signal- to-noioe  ratio  i3  the  one  which 
is  the  absolute  optimum  for  this  cose. 

If  a filter  can  he  built  for  which  the  output  ratio  of  peak  sigtxxl  to 
ras  noise  is  nearly  the  seas  as  that  obtained  with  an  14*^1  filter,  tyn  this 
filter  will  give  results  nearly  as  good  as  the  ideal  filter.  The  noise  power  at 
the  output  of  a filter  with  transfer  function  a (u  ) is  equal  to 


M • VQ  j*0  E(w  ) H(w  ) 


(5.*) 


^5eo  footnote,  p.  6% 
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where  jfQ  la  the  noioe  pever  per  unit  bnaftwidth  of  the  input  noise*  S/  Tarcovnl’o 
theoraa,*  and  tho  fact  that  h(t),  the  irpuloe  response,  la  the  fourlur  tranafam 
of  H {«)• 


JO 

S * Kg  J H{CJ ) h(«)  d U 


\ j h(t)h{t)at* 
-© 


(5-5) 


In  tho  case  of  the  ideal  filter,  Eq.  k.lD  can  he  applied,  end  the 


result  is 


H0  J * (P-r)  2 dr  » 


(5.6) 


where  S is  the  signal  energy.  The  peek  voltage  output  if  these  la  signal  but 


so  noise  is 


/. 


(t)  ‘it  a I , 


(5-7) 


and  banco  the  peal,  signal  power  at  the  output  is  E2.  The  ratio  of  peek  signl 

V 

power  to  average  noise  power  is  thus  JSL  far  the  Ideal  case. 

*o 

Far  tho  particular  case  of  the  slgial  consisting  of  a single  rectangu- 
lar pulse,  if  an  EC  filter  la  used  with  tine  constant  80j5  of  the  pulse  duration. 


the  receiver  operating  characteristic  vill  he  the 


as  if  the  ideal  filter 


ware  used  and  the  sigul  reduced  0.90  db.  This  is  derived  in  Appendix  T. 
Several  other  puloo  cooes  have  been  treated  and  the  results  for  the  beet  filter 
of  each  type  arc  ounaarized  in  tho  following  tables 


^Titchnaroh,  An  Jntroduo 
sciliy  irons,  23S5JT,  ffw  30*. 


;o  the  '/ 


.Gocford'Gniver- 
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TABLE  IX 


Pulse 


Gaussian 

Rectangular 

Rectangular 

Rectangular 

Rectangular 


Filter 

Equivalent  Loos 
In  Signal  Strength 

Rectangular  Passbend  J 
Goi  ' >n  Passbond  J 

0.98  db1 

Rectangular  Passbond 

0.85  db1 

Single  RC  Filter  (or 
SlngLo  Tuned  Circuit) 

0.00  dh 

N Inpulse 

— 1 N response 

0.51  db 

Pn.  impulse 

— * ' response 

1.62  db 

Single  RC  Filter  (or 
Stogie  Tuned  Circuit) 

2.67  db 

The  ntoivaa  equivalent  loss  was  obtained  by  adjusting  the  bandwidth 
of  the  filter.  Thus  In  detecting  pulses  the  form  of  the  filter  passbend  la 
relatively  unimportant.  Ecversr,  it  is  important  to  have  the  correct  filter 
bandwidth.  This  is  essentially  the  present-day  attitude  in  building  receivers 
for  receiving  pulses  of  known  frequency. 

5.3  Conclusions 

Part  H of  The  Theory  of  Slfgial  Detectability  consists  of  the  applica- 
tion of  the  theory  presented  In  Part  X to  sccto  special  cases  of  slf^al  detection 
pr tiMtma  in  order  to  obtain  inf  oration  on  (1)  the  design  cf  .qpfclaas  receivers 
for  the  detection  at  signals*  and  (2)  the  perf oroaace  of  these  receivers. 

\hese  cases  are  derived  in  Lawson  and  Uhlenbeck,  Ref.  1,  p.  20 6. 
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!T1»  special  ccboo  vhich  ore  presented  wears  chosen  free  Its  si.qptcat 
parofclenB  in  bI&ibJ  detection  «hich  clooely  represent  practical  sitsatiasa.  They 
arc  listed  in  !Table  I along  with  ozanpleo  cf  engineering  pcrcfclcae  in  vhich  the/ 
find  applicatlor . 


Section 

Description  of 
Bigial  Kncreftle 

Application 

b.2 

Signnl  Ehawn  Exactly 

Coherent  radar  vith  a target  of 
known  range  and  character 

Signal  Known  Except  far 
Ihase 

Ordinary  pulse  radar  vith  no  inte- 
gration and  vith  a target  of  known 
range  and  character. 

Signal  a Sargis  of  Whits 
Gcusaian  Hoist 

Detection  of  noieo-Uks  signals; 
detection  of  speech  sounds  in 

OaiuMftjtti  noise. 

*.5 

Video  Design  of  a Stood 
Send  Becelasr 

Detecting  a pulse  of  tewa  start- 
ing tins  (such  as  a pulse  frost  a 
radar  beacon)  vith  a crystal-video 
or  other  typo  broad  baud  receiver. 

V.6 

A Radar  Case  (A  train  of 
pulses  vith  incoherent 

Ihaae) 

Ordinary  poise  radar  vith  inte- 
gration end  vith  a target  of  known 
range  and  character. 

*.8 

SlgsO.  Ons  of  X Orthogo- 
nal 

Coherent  radar  where  the  tergst  is 
at  cos  of  a finite  rusher  of  non- 
overlapping  positions. 

Sign!  Cbe  of  M Orthogo- 
nal Signals  Bsown  Except 
for  Ifcass 

Ordinary  pulse  radar  vi  th  no  inte- 
gration and  vith  a target  which 
nay  appear  at  oao  of  a finite 
neater  of  non-owarlsppiag  post- ■ 

tXoQB* 

m , r—rTTW* tty * t . it-ri  <r. 
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In  the  Inst  two  coses  the  uncertainty  in  the  signal  con  he  varied,  and  sow 
light  is  thrown  on  the  relationship  between  uncertainty  and  the  ability  to 
detect  signals.  The  variety  of  examples  presented  should  serve  to  suggest 
acthods  far  attacking  other  eimple  signal  detection  problems  and  to  give  insight 
into  problems  too  c explicated  to  allow  a direct  solution. 

It  should  be  borne  in  mind  that  this  report  discusses  the  detection  of 
signals  in  noise;  the  problem  of  obtaining  information  freo  signals  or  about 
signals,  except  as  to  whether  or  not  they  are  present,  is  not  discussed.  Fur- 
thermore, in  treating  the  special  cases,  the  noise  was  assumed  to  be  Gaussian.*- 

2 

In  addition  to  General  remarks  cn  receiver  design,  moat  sections  on 
special  cases  Include  specific  information  describing  the  simplest  design  for 
the  optimal  receiver  for  the  coco  considered  in  those  sections. 

For  the  single  cases,  the  design  indicated  corresponds  closely  to  the 
design  indicated  by  the  type  of  analysis  in  which  signal  to  noise  ratio  is 
assist  red.  Far  the  mre  complicated  cases,  the  design  suggested  is  usually 
impractical.  For  seas  problems  it  may  never  be  practical  to  attempt  to  build  an 
optima,  system.  For  others,  however,  engineers  equipped  with  a good  understand- 
ing of  statistical  methods  and  their  application  to  the  problem  of  sIjjmI 
detectability,  and  to  communication  theory  in  general,  will  undoubtedly  invent 
systems  which  approach  the  optimum  system. 

For  each  special  case  treated  in  this  report,  at  least  on  approximation 
Is  given  for  the  receiver  performance.  Receiver  performance  roceived  primary 
eq^msis  because  it  has  generally  been  slighted  in  previous  work.  It  is 


4gac  'the  aectaoto 

nocEsn* 

2 

See  Section  5.2. 


am  page  % with 


to  the  spectrum  of  the 


i 
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important  ■to  tec v the  perfc imms  which  could  he  obtained  tra a on  optica® 
^acetter  m if  an  optima  receiver  cannot  be  built,  since  thia  given  on  upper 
bound  on  the  perfcrssnsce  'which  can  ho  obtained  with  any  receiver  in  a given 
eituaticfc,  and  since  thin  also  given  an  upper  hound  on  what  con  possibly  he 
acccsspiisiied  by  irprovoaaata  in  rocoiver  deaigu 
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APPEHDIX  P 
’The  Sampling  Theonea 

Suppose  f(t)  -is  a aeasureable  function  vhich  is  defined  for  0$  t £ ?. 
Then  f(t)  con  he  expanded  in  a Fourier  aeries  In  this  interval.  The  frequency  of 
any  terns  in  the  series  is  an  integral  saHtipla  of  l/?.  Suppose  there  are  no  tenas 
in  the  series  vith  frequency  above  w3  This  sates  the  function  band  United, 
Denote  by  ^(t)  the  function 


oin 

*(2W) 

i] 

(2WT)  sin 

(DO) 


Then 


f(t) 


2HT 

X 

w*k 


'(*)«•» 


CD.2) 


Furthermore,  the  functions  ^ axe  orthogonal  on  the  Interval  0£t<T, 
* 


y ♦jt)  ^(t) « 
0 


FS 


and 


x 

/ 


■where  S ^ la  the  Kronecter  delta  function,  which  la  zero  if  k / a and  unity  if 


rWe  shall  assume  2WT  is  an  odd  integer.  This  equivalent  to  choosing  the  Halt, 
of  the  band  half  way  between  the  frequency  of  the  last  non  zero  tern  in  the 
Fourier  series  arvl  the  frequency  of  the  next  tens  (which,  of  course,  has  a 
zero  coefficient),  t 
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It  follcvs  from  Eq  (D»2)  and  Eq  (D.j)  that 


/ h 


[■(*)] 


sad  from  £qa  (D.2)  and  Sq  (D.4) 


(D.5) 


«*>»  ‘sM  *(§,) 


o>.«) 


25ws  the  r??  functions  ^ have  the  ease  properties  for  the  finite 
interval  vhich  Shannon1*  interpolation  functions  have  on.  the  infinite  interval.1 
2%  is  interesting  to  note  that  i&en  £HI  la  large,  these  functions,  except  the 
ohm  mm?  the  ads  of  the  interval,  are  approximately  the  earns  aa  Shannon's. 

Tourier  merles  for  ^a(t)  has  no  terms  vith  frequency  shove  V. 

It  is,  in  exponential  form, 

w*5 

*-(t)  - ® Z *4  vl  <»•« 

=--{«Li)  j i j 

SMs  ion  he  shown  hy  expressing  the  sine  functions  in  Sq.  (Da)  ss  exponential* 
and  using  the  algebraic  identity 


ml  -a-l  * 

“a  : a-i  * 2 
hi«s 


C».8) 


i 

rw»£ta  (D.4)  can  he  proved  by  integrating  Bq  (D.7)  directly.  Kite 
that  the  only  tens  -which  contributes  to  the  integral  is  the  term  for  vhtah 


See  Shannon,  Ref.  £1. 


Mil  1 iftw  tli,  w'h  Mtf  (inSlttiliilWi  A'  "dattkaBhMW*^  M W'1 


I 
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Foroule  (0.3)  earn  beat  be  proved  also  by  using  the  jRoarler  series* 


/ *,(*>  *k<t}  * 

0 


T W*  i 

r a 


i 

(2WT)^ 


f C •*!*  ssH*  ¥*]  C ^ f*] 


O a « 


T -(W-l) 


W-  i VI  - i 

2 2 


^ H X2"[3 

n-^ST-|)p»  ^W3N-|) 


W - 1 1 

^ e:  x zi  h*  *», 

' n-^|)pe^|)  * 

W-l 

2 

T f.  -2*n(#4t>1 

(air)®  ®®  J * 

1 1 n*-(wr-|) 


If  m ® t,  each  of  the  SWT  terns  la  the  am  Is  unity.  If  * / k,  the  terns  la  the 
sub  ere  equally  spaced  uxofni  the  vjdt  circle  la  the  eong&ex  pleas  and  smst  mm 


to  zero.  Thus 


T 

/*,<***(*>  dt 


*aT  » 


vhlch  vas  to  be  proved* 


•X' 

■'  * 


: i&rs&e&r 


1 1*  */**  tf.'j 
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The  validity  of  the  expansion  in  equation  (D.2)  follows  from  the 
fact  that  the  functions  ^B{t)  are  2W?  linearly  independent  linear  c cabinet Iona 
of  the  SOT  functions 

e*p[i  —*.]  f-OTSnSW-i 

which  ere  used  is  the  Fourier  series  sj.psnsion.  Thus  any  function  which  csw  ha 
expanded  in  a Fourier  series  with  only  the  first  2OT  tents  can  also  he  expanded 
in  a unique  way  in  terns  of  the  functions  \ 

There  la  an  alternate  fora  of  the  stapling  theorem  for  hand  Halted 
signals*  With  this  fora  the  signal  function  can  he  described  by  giving  scrapie 
values  of  the  envelope  and  phase  of  the  signal,  and  hen -e  this  font  la  often 
convenient  to  use  in  describing  rf  signals* 

Suppose  the  function  f(t),  when  expanded  in  a Fourier  aeries  on  the 
interval  0»  t £ ? has  only  a finite  masher  of  tents  in  its  expansion,  and 
suppose  they  axo  included  in  the  tease  ranging  fron  frequency  fj_  to  frequency 
fg*1  The  beahrtdth  then  could  he  defined  as 


* • *2 - fi  * § » * 

(0.9) 

and  the  center  frequency  is 

m f2  + *l 

(0.10) 

2s  2 

Then  the  Fc  rier  series  can  he  written 

* r i r 

4* 

f(t)  » I a cos  /»  + k} tj  ♦ sin 

/«+  l*k)t 

(0.11) 

Hi  l J L 

% • * 

* M 

tit)  - e[  2 tj  1 

where  R aeana  "the  real  part  of':,  and  a a i (OT  - 1), 


35te  shail.  assume  ffg  - Tfp  1$  an  even  integer  and  that  Tfn  £ 1* 

waapaw  — >■  — *■*  mini  iiamur  mmm-m  ■■  i nan  in  m*..— ..in  Maaaaaa*  'fC  a 


(0.12) 


WF* 


r i 
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r(t)  " * [®»  J 

r /»  . t 

- * c*p[lat]  (x(t)  . irtt))J 

* *ft)  cos  cut  + y(t)  aia  iat 


vhere 


i ?-[*%*], 


j(t)  mm  £ ^ egp  jTf  grfct  j ^ 


(D^) 


x ) 80,2  **«t  the  conflitloas  of  the  ttrst  fona  of 

•aspllsg  theorea,  Jbr  a fra***^  ^ ^ ^ 

They  cea  be  cxpreased  therefor  la  the  ft»»  2 # 

*(t>  ‘ * *(b)  K « 

*■1 


3r(t)  "2  *(§)*k<t) 


0U3) 


Thus  the  original  function  can  be  wtttea  M 2 

**  “ i ^ « ^*£oww-~» . 
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ana  the  function  f(x)  can  be  represented  by  giving  the  saople  values  x 
and  yg).  j 

Since  f (t)  can  be  expressed  in  the  fora  j 

t(  t)  * x(t)  cos  cut  + y(t)  sin  ait  (D.1J) 

and  xft)  and  y(t}  are  United  to  frequencies  less  than  ~ vhich  is  less  .than  — , 

2 2x 

the  envelope  of  f (t)  Is 


r(t)  a V x(t)2  + y{t)2 

CD-I?) 

The  angle  C(t)  defined  by  . . 

coe  o(t)  » 2j|l 

ain  8(t)  - * 

(D.2B) 

can  be  considered  as  the  phase  of  the  signal,  since 

f(t)  - r(4)  cos  8(t)  cos  vt  - r(t)  sin  0 (t)  sin  vfc 
**  r(t)  cos  [wt  ♦ ®(t)j  (DJL?) 

Mote  that  the  sample  values  and  can  be  obtained  from  staple 
values  of  r and  Oy 


*i  * *{$)**($)«»[•($)]* 

« Tj,  ain  ©1 


(0.20) 


Unis  the  function  f(t)  say  be  represented  by  giving  the  sample  values  of  its 
amplitude  and  phase  at  point*  spaced  ^ apart  throu^j  the  observation  interval. 
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tfgaagxg 


lateral 


”t  t*t>  ,/k  M**  «*  l-i] 


tea) 


*«  required. 


Hie  integral 


fi 


\ (to) 


- y *&* 

™Tj  ko0(U)Ss3,r  » (*•») 

'(here  J («4U  Is  . ^ 1 4.  *. 

r ft.,-..  ? ^ 

2*,  Ocr)  «n  be  eapa^*!  in  a pcwer 


8 Sta  at 

**  - 1 te 


(2.3) 


»«  «■  Utegna  csa) 

top(^)  /[yto)J8n^[.^j 

(Subatifcufcfcqj  (SO)  Hot  I {!»)) 


(*«*) 


**P  {-*?)  ( l oa 


2n  2b 


Hsr  Vta)°^-¥J 


(S.5) 


u"*“*  “*  “*«**>*.  acr.  ^ 


4m  •.< 
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„ CO  /*!  2n  r ’£  ■»  . 

■ ^(-»2)  1 ji^r—  *»[-  V]*  tE-6) 

n--0  0 2 ^un* 

(Substituting  from  (E.2)) 

“ ^“b2)  £ ;-,^T  ai2  HP?]  £ (n-k)ikikT2k 

. c V-A 


, ,2*  ® b^*  Mtoa  awrb2l  r n»  h2* 

a exp  {-b  ) £ — a-2  exph\|  (n.^ikik 

2 n.n.  k*0 


2 CO  n lj2a+2k 
C ^ j^0  L 2>**{n-k)iklkl 

(Rearranging  the  terms  in  the  double  sub) 

21  ® ® b2n+2k 

cxpL"  TJ  ^ n«k  2n+ic(n-k) iklki 


(E«8) 


CO  CO 


expf-  3l1  X £ 

E * J ui  nst 


^k^an-ak 


kaO  n=k  ^ 2n““  klki  (n-k)J 


(2.9) 


(E.10) 


(letting  n » n-k) 


o w w 
«*[-  £112 
fc*0  a-0 

-CO  j.k 

«*[-£!  i 

» 2 J u.a  o2k  ipt 


> h 

1 kiklni^1 

(2»H) 

CO 

£ iL 

0sa2) 

a-0  ai? 

t]-  h <*> 

(B.15) 

The  steps  In  this  derivation  vhish  oust  he  justified  ore  interchanging 
the  order  of  integration  and  summation  at  step  (£.6)  and  rearranging  the  double 
sun,  at  steps  (£.9)an d (E,12).  It  Is  easy  to  show  that  the  integral  exiats. 

The  integrands  in  (£,.6)  are  uniformly  bounded  by  the  integrand  in  (E.A1-*  Thus 

i - ■ — 79  — ■ 
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the  integrals  is  (S.6)  converge  uniformly,  sad  the  order  of  Integration  and 
sussaation  can  be  interchanged.  As  for  rearranging  double  stags,  this  is  possible 
since  all  the  teras  are  positive,  and  hence  the  convergence  is  absolute. 


• ayrruf  r-iifHftstes 


1 v 

J 
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APFEWDIX  F 

Let  u*  consider  a simple  case  of  approximating  the  ideal  filter  by  some 
other  filter.  Suppose  s(t)  is  a rectangular  pulse  of  energy  B and  width  d. 

Then  r— 

«(t)  «/§  trostsa 

Vd  <F.l) 

= 0 otherwise 

Suppose  the  filter  is  made  up  of  a single  resistor  and  a single 
condenser,  vith  an  amplifier  or  attenuator,  ‘whichever  is  needed  to  sake  the 
noise  power  at  the  output  IT0E  as  in  the  ideal  case.  Then  the  impulse  response 
is  of  the  for*  . 


h(t)  - h0*  T iftiO 
« 0 otherwise 


(?.  2) 


where  r is  the  tine  constant  of  the  filter  and  hQ  is  a constant  depending  on  the 
gain  of  the  amplifier  or  attenuator.  The  requirement  that  the  noise  power  at 
the  output  be  lys  la,  by  (5*6),  equivalent  to  requiring  that 


which  yields 


/[»“’] 2 
-CO 

/"  2 -St  »c2r 

J h e r at  - 

0 o 2 

(y.5) 

(?.*> 

™ , and 

(?>5) 

• </?  e r if  t i 0 

(P.6) 

* 0 otherwise 

The  response  V(t)  of  this  filter  to  the  pulse  s(t)  is,  by  (4  JJL), 


v(t)  - J'  s(\)  h (t-\)  d k. 

a.  


<F.  7) 


1 


,»wt  to  «.■»*.  i, n ,/ 
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On  Statistical  Approaches  to  the  Signal  Detectability  Problem: 


1.  Dawson,  J.  L.,  and  Uhlenbeck,  0*  E.,  Threshold  Signals,  McGraw-Hill,  New 
loxfc,  3950. 

This  hook  Is  certainly  the  outstanding  reference  oa  threshold  signals,  a 
presents  a great  variety  of  both  theoretical  and  experimental  work*  Chap- 
ter  7 presents  a statistical  approach  of  the  criterion  type  for  the  aipral 
detection  problea,  and  the  idea  of  a criterion  which  minimizes  the  proba- 
bility of  an  error  la  Introduced.  (This  la  a special  case  of  air  optimal 
criterion  of  the  first  type.) 

8.  Davies,  1.  D.,  "On  Determining  the  Presence  of  Signals  in  Noise,"  proe. 
I.S.S.  (London),  Toi.  99 , Part  in,  pp.  *5-51*  March,  1952. 

3.  Woodward,  P.  X.,  and  Davies,  X.  L.,  "Information  Theory  and  Inverse  proba- 
bility In  Telecoenraclcatlon, " Proe.  I.E.R.  (London),  Viol.  99,  Part  in, 
p.  37,  March,  195*2. 

*•  Woodward,  P.  X.f  and  Davies,  X.  L,  "A  Theory  of  Radar  Information," 

Phil.  Mig.,  Vol.  tl,  p.  1001,  1950. 

3.  Woodward,  P.  X.,  "Information  Theory  end  the  Design  of  Radar  Receivers," 
Free.  IJt.g.,  Pol.  39,  p.  152U 

Woodward  and  Davies  have  Introduced  the  Idea  of  a receiver  having  a pen 
terlorl  probability  as  Its  output,  and  they  point  out  that  such  a receiver 
gives  a aaxiaua  asount  of  information.  They  heve  handled  the  esse  of  an 
arbitrary  signal  function  known  exactly  or  known  except  for  phaae  with  no 
sore  difficulty  than  other  authors  have  had  with  a sine  wave  signal. 

Their  methods  serve  aa  a basis  for  the  second  part  of  tMq  report. 


Reich,  £,,  and  Swelling,  ?.,  "The  Detection  of  a Sine  Wave  Is  Bma^^ 


Boise, 


Vol.  £*,  p.  2 99,  March,  3955. 


This  paper  considers  the  problem  of  finding  as  optima  criterion  pf  the 
second  type  presented  ir  this  report)  for  the  case  of  a sine  wave  of 
duration,  known  amplitude  and  frequency,  but  urJcaovn  phase  in  Ihe  presence 
of  Gaussian  nolee  of  arbitrary  autocorrelation.  The  method  probably  could 
be  extended  to  more  general  problem.  Go  the  other  bond,  the  methods  of 
this  report  cm  be  applied  if  the  aignala  are  band  Halted  even  in  the  case 
of  nen-unifeaa  noise  by  putting  the  signals  and  noise  through  an  iaaglnary 
filter  to  arise  the  noise  unifora  before  applying  the  theory.  Sot  '.The 
Theory  Qg  Signal  geftegta&aLEgft^.  aarfr  3^  g tofcftnt  J.1?.  
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7.  Middleton,  D.,  "Statistical  Criteria  for  the  Detection  of  Pulsed  Carriers 
in  Ifoise,  Jour,  Appl,  Phy3,,  Vol.  24,  p.  371,  April,  1953* 

A thorough  discussion  is  given  of  the  problem  of  detecting  pulses  (of  un- 
known phase)  in  Gatmitm  noise.  Both  types  of  optimum  criteria  are 
discussed,  but  not  in  their  full  generality.  The  sequential  type  of  test 
is  discussed  also.  ’■Uddleton  *o  equation  (G’.l)  dooo  not  hold  for  the 
sequential  test,  and  as  a result,  his  calculations  for  the  minima 
detectable  signal  with  a sequential  toot  are  incorrect.  Tho  discussion 
of  the  tests  is  not  clear.  Tho  comparison  of  the  tests,  which  are  dosioied 
to  optimize  different  quantities,  seems  Inappropriate ; each  tost  accaa- 
pllehos  its  own  task  In  the  beat  possible  way. 


8,  Slattery,  T.  0.,  *The  Detection  of  a Sine  Wave  in  Noise  by  the  Use  of  a 
Non-Linear  Filter,"  Proc.  2.R.S.,  Vol.  4o,  p.  1232,  October,  1952. 

This  article  considers  tho  problem  of  detecting  a sine  wave  of  known  dura- 
tion, amplitude,  and  frequency,  but  unknown  phase  in  uniform  Gaussian 
noise.  Tho  article  contains  several  errors,  and  the  results  are  not 
clearly  presented. 

9.  Hsnse,  H.,  “The  Optimisation  and  Analysis  of  Systems  for  the  Detection  of 
Pulsed  Signals  in  Random  No:..se,i1  Doctoral  Dissertation  (ME?),  January,  1951* 

10.  Sjhwartz,  M.,  "A  Statistical  Approach  to  the  Automatic  Search  Problem," 
Doctoral  Dissertation  (Harvard),  June,  1951* 

These  dissertations  both  consider  the  problem  of  finding  the  optima*  re- 
ceiver of  the  criterion  type  for  radar  type  signals. 

11.  Horth,  D.  0»,  "An  Analysis  of  the  Factors  which  Determine  Signal-Noise  Dis- 
crimination in  Pulsed  Carrier  Systems,"  RCA  Laboratory  Report  FTF-6C,  1943. 

The  ideas  of  false  slam  probability  and  probability  of  detection  are 
introduced.  North  argues  that  these  probabilities  will  be  most  favorable 
when  peak  signal  to  average  noise  ratio  is  largest.  The  ideal  filter, 
which  maximises  this  ratio,  is  derived,  (This  commentary  is  based  on 
second-hand  knowledge  of  the  report*) 

12.  Kaplan,  S.  M.,  and  Fall,  R,  W„,  "The  Statistical  Properties  of  Noise  Applied 
to  Radar  Range  Performance,"  Prsc,  I.R.E,,  Vol.  39,  p,  %,  January,  3551. 

The  ideas  of  false  alarm  probability  and  probability  of  detection  are  in- 
troduced and  an  example  of  their  application  to  a radar  receiver  Is  given. 
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* 

Kareun,  J.  Icy  "A  Statistical  Theory  of  Target  Detection  *y  Pulsed  Radmrs..* 
Mathematical  Appendix,"  Band  Corporation  Report  2-113*  J«iy  1*  1948. 

This  report  contains  a careful*  thorough  study  of  the  aathemtical  problen 
■which  It  considers.  • 


On  Stetistics: 

13.  Nfeynsa,  J.,  and  Pearson,  E.  S.,  "(hi  the  Prohlea  of  the  Most  Efficient  Tests 
of  Statistical  hypotheses,"  Phil.  Trans.  Roy.  Soc.,  Vol.  231.  Series  A. 

P.  269,  1055. 


14*  Cr sner,  2 .,  Mstbenatical  Methods  of  Statistics,  pxiscetoa  thirerAty  Press, 
Princeton,  1931. 
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Cn  Related  Topics: 

15*  Dvork,  B.  M.,  "Detection  of  a Pulse  Superimposed  on  Fluctuation  Noise,* 
Proc.  I.R.E,,  Vol,  38,  p.  m,  July,  1950. 

16.  Barrington,  J,  V.,  end  Rogers,  T.  "Signal-to -Noise  Improvement  Through 
Integration  in  a Storage  Tube,*  Proc.  I.R.E.,  Vol.  38.  v.  1197,  October. 
1550. 

17.  Harting,  A.  1 , and  Meade,  J,  E»,  "A  Device  for  Computing  Correlation  Func- 
tions," Rev.  Sci.  Inst,,  Vol.  23,  3*7,  1952. 

18.  loe,  T.  V.,  Chcathan,  T.  p.,  Jr.,  and  Wlesner,  J.  5.,  "Applications  of 
Correlation  Analysis  to  the  detection  of  Periodic  Signals  In  Koiao,"  Proc. 
I.BJ2.,  Vol.  39,  p.  lift,  October,  1550. 

19*  Levin,  X.  J,,  and  Reintzes,  J.  "A  Five  Channel  Electronic  Analog 
Correlator,"  Proc.  Bat.  El.  Conf Vol.  8,  1552. 

20.  Bice,  S.  0.,  ^athesatieal  Analysis  of  Kanuoa  Dulse,"  B.S.7.J..  Vol.  23. 

p.  202-332  and  Vo3u  24,  p.  46-156,  1545-6.  

21,  Shannon,  C.  2.,  "Crsxaanication.  in  the  presence  of  Noise,"  Proc. 

Vd.  37,  jp.  10-21,  January,  1949s. 
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A 

AX(S) 

*200 

Ck 

d 

S,  E(a) 

E* 

fH(x) 

fSff(x) 

V0)'  fh< 

k 

i(x) 

a 

9 

*o 

*g{A) 


The  event  ’The  operator  nays  there  la  signal  pixie  noloe  prosent," 
or  a criterion,  i.c. , the  oot  of  receiver  inpute  for  which  the 
operator  nays  there  is  a signal  present. 

Any  criterion  A which  maximises  ?~.(A)  - p ?.,{A),  i.e.,  an  opti- 
ons criterion  of  the  firot  type.  “**  " 

Any  criterion  A for  which  P„(A)  ^ k,  and  P™(A),  la  maxiaua,  i.e., 
an  qptiaua  criterion  of  thewsecond  type,  **** 

The  event  "Tho  operator  oaya  there  io  noioo  alcese." 

A parameter  describing  the  ability  of  a receiver  to  detect  signals. 
(See  Section  5.1  and  Fig.  5.1.) 

Tho  siojal  energy, 

Tho  n-dimenelonal  Euclidean  space. 

The  probability  density  for  points  x in  H if  there  is  noise  alone. 

The  probability  density  far  points  x In  B if  thore  is  signal  pi Jm 
noioo. 

The  complementary  distribution  function  far  likelihood  ratio  if 
there  is  noise  alone,  i.o.,  F^(p)  is  the  probability  that  the 

likelihood  ratio  will  be  greater  than  p if  there  is  noiso  alone. 

Tho  complementary  distribution  function  for  likelihood  ratio  if 
there  is  oigrnl  plus  noise. 

A symbol  used  primarily  for  the  upper  bound  placed  on  false  alam 
probability  P (A)  in  tho  definition  of  the  second  kind  of  optisua 
criterion.  u 


The  dimension  of  the  apace  of  receiver  inputs,  n » 2WT  . 


The  event  "Thoro  is  noise  alone,"  or  the  noise  power. 

The  noiso  power  per  unit  bandwidth.  I7Q  ■ 9 /it  . 

The  probability  that  the  aerator  will  say  there  is  signal  pins 
noise  if  there  io  noise  alone,  i.e.,  the  false  alarm  pyjfodfcOfSy. 


t a 
l 4 
i 1 


^(B) 


Ms*W 

/*iW 
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Tho  probability  that  tho  operator  will  aay  there  is  signal  plus 
nolao  if  there  is  olgaol  plus  noioe/  i*e*»  the  probability  of 
detection. 

Tho  a posteriori  probability  that  there  ia  signal  plus  noise 
present.  (Seo  Sections  1 3 and  £«3*) 

Tho  probability  noaeuro  defined  on  11  for  tho  set  of  exported 
signals. 

The  apace  of  oil  receiver  inpato.  (Tho  set  of  all  possible  sig- 
nals is  the  sene  space.) 

A signal  s(t),  voich  any  aloe  ho  considered  as  a point  s In  B 
vith  coordinates  (e^,  g^,  , • on)* 

Tho  event  ‘'Thera  is  signal  r^ufl  nolao,0 

Tins. 

Tho  duration  of  the  observation. 

The  bandwidth  of  the  receiver  inputs. 

A receiver  input  x(t),  which  my  aloo  bo  considored  as  a point  z 
in  B vith  coordinates  (x^,  Znt  • « *$  *n) 

A syrsbol  usually  used  for  tho  likelihood  ratio  lovol  of  an  optima 
criterion. 

The  man  of  the  randan  variable  x if  there  is  signal  plus  noise. 
Sw  naan  of  tho  rsadoa  variable  x if  there  is  noise  alone. 

The  variance  of  the  random  variable  t if  there  is  noise 
Th«i  variance  of  likelihood  ratio  if  thore  is  noise  ^ >w>. 


Eorte:  The  terns  ’Cornel  distribution"  and  "Gaussian  distribution"  have  been 
used  interchangeably  in  this  report. 
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